[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:39:32 dist-test-slave-qg60 krb5kdc[752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:39:32 dist-test-slave-qg60 krb5kdc[752](info): set up 2 sockets
Aug 11 12:39:32 dist-test-slave-qg60 krb5kdc[752](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 12:39:34.376683 745 mini_kdc.cc:121] Time spent starting KDC: real 1.551s user 0.005s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:39:34 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:39:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:39:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:39:34.712846 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42125
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:42125
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:35.297750 767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:35.298113 767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:35.298287 767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:35.305907 767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:39:35.306051 767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:35.306151 767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:35.306263 767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:39:35.306351 767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:39:35.316871 767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:42125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:35.318430 767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:35.319891 767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:35.333657 774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:35.333680 773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:35.333868 767 server_base.cc:1034] running on GCE node
W20260811 12:39:35.333633 776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:35.335029 767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:35.336567 767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:35.337836 767 hybrid_clock.cc:648] HybridClock initialized: now 1786451975337780 us; error 85 us; skew 500 ppm
I20260811 12:39:35.338241 767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:35 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451975, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:35.341944 767 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:39:35.343570 767 webserver.cc:460] Webserver started at http://127.0.186.126:36143/ using document root <none> and password file <none>
I20260811 12:39:35.344264 767 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:35.344372 767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:35.344677 767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:35.348160 767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "96b2dfb0ed314aac99464616eae5dcab"
format_stamp: "Formatted at 2026-08-11 12:39:35 on dist-test-slave-qg60"
server_key: "b8e7cbe727cf1dac1076cc5fec8de5c6"
server_key_iv: "03d858a02b44cb9a575d262832b7d87c"
server_key_version: "encryptionkey@0"
I20260811 12:39:35.349257 767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "96b2dfb0ed314aac99464616eae5dcab"
format_stamp: "Formatted at 2026-08-11 12:39:35 on dist-test-slave-qg60"
server_key: "b8e7cbe727cf1dac1076cc5fec8de5c6"
server_key_iv: "03d858a02b44cb9a575d262832b7d87c"
server_key_version: "encryptionkey@0"
I20260811 12:39:35.355278 767 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 12:39:35.359107 784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:35.360534 767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:35.360843 767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "96b2dfb0ed314aac99464616eae5dcab"
format_stamp: "Formatted at 2026-08-11 12:39:35 on dist-test-slave-qg60"
server_key: "b8e7cbe727cf1dac1076cc5fec8de5c6"
server_key_iv: "03d858a02b44cb9a575d262832b7d87c"
server_key_version: "encryptionkey@0"
I20260811 12:39:35.361081 767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:35.383553 767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:35.389285 767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:35.389663 767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:35.412317 767 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:42125
I20260811 12:39:35.412352 842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:42125 every 8 connection(s)
I20260811 12:39:35.413887 767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:39:35.417991 843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:35.421021 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 767
I20260811 12:39:35.421365 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:39:35.423334 745 external_mini_cluster.cc:1428] Setting key 92cde1cd0de537863a5ce675c6a7cfec
I20260811 12:39:35.431245 843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab: Bootstrap starting.
I20260811 12:39:35.434656 843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:35.435825 843 log.cc:824] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:35.439258 843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab: No bootstrap required, opened a new log
I20260811 12:39:35.447288 843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b2dfb0ed314aac99464616eae5dcab" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42125 } }
I20260811 12:39:35.447739 843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:35.447870 843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96b2dfb0ed314aac99464616eae5dcab, State: Initialized, Role: FOLLOWER
I20260811 12:39:35.448591 843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b2dfb0ed314aac99464616eae5dcab" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42125 } }
I20260811 12:39:35.448958 843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:39:35.449110 843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:39:35.449314 843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:35.451921 843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b2dfb0ed314aac99464616eae5dcab" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42125 } }
I20260811 12:39:35.452513 843 leader_election.cc:302] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96b2dfb0ed314aac99464616eae5dcab; no voters:
I20260811 12:39:35.453321 843 leader_election.cc:288] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:39:35.453439 853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 1 FOLLOWER]: Leader election won for term 1
Aug 11 12:39:35 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:35.454557 853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [term 1 LEADER]: Becoming Leader. State: Replica: 96b2dfb0ed314aac99464616eae5dcab, State: Running, Role: LEADER
I20260811 12:39:35.455302 853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b2dfb0ed314aac99464616eae5dcab" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42125 } }
I20260811 12:39:35.456182 843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:39:35.460881 855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96b2dfb0ed314aac99464616eae5dcab. Latest consensus state: current_term: 1 leader_uuid: "96b2dfb0ed314aac99464616eae5dcab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b2dfb0ed314aac99464616eae5dcab" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42125 } } }
I20260811 12:39:35.461431 855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:35.466672 854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96b2dfb0ed314aac99464616eae5dcab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b2dfb0ed314aac99464616eae5dcab" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42125 } } }
I20260811 12:39:35.467674 854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:35.474561 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:35.427735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45516 (local address 127.0.186.126:42125)
0811 12:39:35.428830 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:35.428850 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:35.430024 (+ 1174us) server_negotiation.cc:407] Connection header received
0811 12:39:35.440108 (+ 10084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:35.440132 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:35.440561 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:35.441081 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:35.444162 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:35.445773 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:35.447566 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:35.448463 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:35.448699 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:35.456058 (+ 7359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:35.456067 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:35.456123 (+ 56us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:35.456186 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:35.462969 (+ 6783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:35.464758 (+ 1789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:35.464771 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:35.464782 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:35.465123 (+ 341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:35.466052 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:35.466060 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:35.466066 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:35.467331 (+ 1265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:35.471564 (+ 4233us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:35.471962 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 12:39:35.472582 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":758,"thread_start_us":467,"threads_started":1}
I20260811 12:39:35.482142 860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:39:35.487757 860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:39:35.499840 860 catalog_manager.cc:1347] Generated new cluster ID: cda77e9746ed4e298bbeb5ffb2529093
I20260811 12:39:35.500000 860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:39:35.525347 860 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:39:35.527397 860 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:39:35.542863 860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96b2dfb0ed314aac99464616eae5dcab: Generated new TSK 0
I20260811 12:39:35.544269 860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:39:35.614359 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42125
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:35.975637 875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:35.976012 875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:35.976194 875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:35.984166 875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:35.984340 875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:35.984530 875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:39:35.995106 875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42125
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:35.996543 875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:35.998157 875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:36.013438 881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:36.013377 884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:36.013309 882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:36.014441 875 server_base.cc:1034] running on GCE node
I20260811 12:39:36.015223 875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:36.016304 875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:36.017540 875 hybrid_clock.cc:648] HybridClock initialized: now 1786451976017478 us; error 54 us; skew 500 ppm
I20260811 12:39:36.017889 875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:36 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451976, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:36.021610 875 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:39:36.023527 875 webserver.cc:460] Webserver started at http://127.0.186.65:39137/ using document root <none> and password file <none>
I20260811 12:39:36.024313 875 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:36.024482 875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:36.024905 875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:36.028187 875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "394ab485cae64d4fa1b468bc8f6e47f7"
format_stamp: "Formatted at 2026-08-11 12:39:36 on dist-test-slave-qg60"
server_key: "df892c4d00ee67198a5c9b17e2ef614d"
server_key_iv: "f06963c787997b0b884b6d4e0627108f"
server_key_version: "encryptionkey@0"
I20260811 12:39:36.029168 875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "394ab485cae64d4fa1b468bc8f6e47f7"
format_stamp: "Formatted at 2026-08-11 12:39:36 on dist-test-slave-qg60"
server_key: "df892c4d00ee67198a5c9b17e2ef614d"
server_key_iv: "f06963c787997b0b884b6d4e0627108f"
server_key_version: "encryptionkey@0"
I20260811 12:39:36.035434 875 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 12:39:36.039417 891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:36.040954 875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 12:39:36.041138 875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "394ab485cae64d4fa1b468bc8f6e47f7"
format_stamp: "Formatted at 2026-08-11 12:39:36 on dist-test-slave-qg60"
server_key: "df892c4d00ee67198a5c9b17e2ef614d"
server_key_iv: "f06963c787997b0b884b6d4e0627108f"
server_key_version: "encryptionkey@0"
I20260811 12:39:36.041359 875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:36.062980 875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:36.068050 875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:36.068403 875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:36.069597 875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:36.071079 875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:36.071204 875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:36.071357 875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:36.071432 875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:36.109510 875 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:33387
I20260811 12:39:36.109614 1019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:33387 every 8 connection(s)
I20260811 12:39:36.110884 875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:39:36.118511 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 875
I20260811 12:39:36.118777 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:39:36.119601 745 external_mini_cluster.cc:1428] Setting key f5a306672ac44d33a076b13dc8c54b67
Aug 11 12:39:36 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451976, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:36.134476 1022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:36.114027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:47575 (local address 127.0.186.126:42125)
0811 12:39:36.114512 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:36.114517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:36.115558 (+ 1041us) server_negotiation.cc:407] Connection header received
0811 12:39:36.117576 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:36.117582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:36.117678 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:36.117800 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:36.120069 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.121034 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.122947 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.123718 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.123886 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:36.127605 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:36.127614 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:36.127622 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:36.127693 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:36.130744 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:36.131783 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:36.131787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:36.131790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:36.131914 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:36.132447 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:36.132451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:36.132453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:36.132794 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:36.132923 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:36.133997 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0811 12:39:36.134202 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":242,"threads_started":1}
I20260811 12:39:36.136201 1023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:36.114628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:42125 (local address 127.0.186.65:47575)
0811 12:39:36.115360 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:36.115409 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:36.117295 (+ 1886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:36.118098 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:36.118110 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:36.118946 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:36.119859 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:36.119895 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.121221 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.121226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:36.122781 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:36.122795 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.123973 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.123979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:36.124217 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:36.125045 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:36.125070 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:36.127361 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:36.130907 (+ 3546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:36.130920 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:36.130941 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:36.131652 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:36.132029 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:36.132036 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:36.132042 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:36.132317 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:36.132938 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:36.132949 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:36.133560 (+ 611us) client_negotiation.cc:769] Sending connection context
0811 12:39:36.133909 (+ 349us) client_negotiation.cc:240] Negotiation successful
0811 12:39:36.134552 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":297,"threads_started":1}
I20260811 12:39:36.138113 1020 heartbeater.cc:347] Connected to a master server at 127.0.186.126:42125
I20260811 12:39:36.138456 1020 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:36.139313 1020 heartbeater.cc:511] Master 127.0.186.126:42125 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
I20260811 12:39:36.141664 804 ts_manager.cc:194] Registered new tserver with Master: 394ab485cae64d4fa1b468bc8f6e47f7 (127.0.186.65:33387)
I20260811 12:39:36.143182 804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:47575
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:39:36.173121 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42125
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:36.541145 1026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:36.541519 1026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:36.541693 1026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:36.549633 1026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:36.549799 1026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:36.549983 1026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:39:36.560510 1026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42125
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:36.562124 1026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:36.563602 1026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:36.578897 1032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:36.578894 1033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:36.579694 1035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:36.580130 1026 server_base.cc:1034] running on GCE node
I20260811 12:39:36.580823 1026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:36.582008 1026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:36.583252 1026 hybrid_clock.cc:648] HybridClock initialized: now 1786451976583214 us; error 34 us; skew 500 ppm
I20260811 12:39:36.583593 1026 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:36 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451976, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:36.586942 1026 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:39:36.588698 1026 webserver.cc:460] Webserver started at http://127.0.186.66:38263/ using document root <none> and password file <none>
I20260811 12:39:36.589462 1026 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:36.589622 1026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:36.589951 1026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:36.593045 1026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "679632ce2b4544e0a5075e63af091047"
format_stamp: "Formatted at 2026-08-11 12:39:36 on dist-test-slave-qg60"
server_key: "acfaebfbc4f887ab81bf74fce5c5f58e"
server_key_iv: "ef0c6e8144d7e70942b7645205fb5939"
server_key_version: "encryptionkey@0"
I20260811 12:39:36.593879 1026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "679632ce2b4544e0a5075e63af091047"
format_stamp: "Formatted at 2026-08-11 12:39:36 on dist-test-slave-qg60"
server_key: "acfaebfbc4f887ab81bf74fce5c5f58e"
server_key_iv: "ef0c6e8144d7e70942b7645205fb5939"
server_key_version: "encryptionkey@0"
I20260811 12:39:36.599356 1026 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:39:36.603132 1044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:36.604597 1026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:36.604848 1026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "679632ce2b4544e0a5075e63af091047"
format_stamp: "Formatted at 2026-08-11 12:39:36 on dist-test-slave-qg60"
server_key: "acfaebfbc4f887ab81bf74fce5c5f58e"
server_key_iv: "ef0c6e8144d7e70942b7645205fb5939"
server_key_version: "encryptionkey@0"
I20260811 12:39:36.605085 1026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:36.645356 1026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:36.650724 1026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:36.651095 1026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:36.652271 1026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:36.653903 1026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:36.654042 1026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:36.654217 1026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:36.654299 1026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:36.695266 1026 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:44493
I20260811 12:39:36.695366 1171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:44493 every 8 connection(s)
I20260811 12:39:36.696805 1026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:39:36.698589 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 1026
I20260811 12:39:36.698832 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:39:36.699343 745 external_mini_cluster.cc:1428] Setting key 86d0c1d1eed2ad81ab955ed6cfefdfa4
Aug 11 12:39:36 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451976, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:36.722533 1175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:36.699712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:53353 (local address 127.0.186.126:42125)
0811 12:39:36.700265 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:36.700272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:36.701458 (+ 1186us) server_negotiation.cc:407] Connection header received
0811 12:39:36.703680 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:36.703686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:36.703779 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:36.703925 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:36.705708 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.706628 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.708508 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.709227 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.709343 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:36.713914 (+ 4571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:36.713926 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:36.713935 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:36.714011 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:36.718371 (+ 4360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:36.719369 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:36.719379 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:36.719384 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:36.719586 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:36.720166 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:36.720174 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:36.720182 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:36.720633 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:36.720833 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:36.721704 (+ 871us) server_negotiation.cc:299] Negotiation successful
0811 12:39:36.722015 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
I20260811 12:39:36.723194 1176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:36.700286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:42125 (local address 127.0.186.66:53353)
0811 12:39:36.701292 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:36.701334 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:36.703359 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:36.704207 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:36.704216 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:36.704878 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:36.705506 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:36.705525 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.706825 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.706838 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:36.708312 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:36.708334 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:36.709534 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:36.709542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:36.709963 (+ 421us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:36.710843 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:36.710867 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:36.713602 (+ 2735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:36.718571 (+ 4969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:36.718581 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:36.718596 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:36.719194 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:36.719743 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:36.719746 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:36.719748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:36.720016 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:36.720847 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:36.720853 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:36.721273 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 12:39:36.721522 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 12:39:36.721942 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":529,"threads_started":1}
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
I20260811 12:39:36.724864 1172 heartbeater.cc:347] Connected to a master server at 127.0.186.126:42125
I20260811 12:39:36.725224 1172 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:36.725996 1172 heartbeater.cc:511] Master 127.0.186.126:42125 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
I20260811 12:39:36.727797 804 ts_manager.cc:194] Registered new tserver with Master: 679632ce2b4544e0a5075e63af091047 (127.0.186.66:44493)
I20260811 12:39:36.729168 804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:53353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:39:36.757726 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42125
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:37.126507 1181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:37.126794 1181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:37.126957 1181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:37.134706 1181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:37.134831 1181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:37.135023 1181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:39:37.146346 1181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42125
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:37.147029 1020 heartbeater.cc:503] Master 127.0.186.126:42125 was elected leader, sending a full tablet report...
I20260811 12:39:37.147897 1181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:37.149541 1181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:37.164178 1186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:37.164148 1187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:37.164415 1189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:37.165207 1181 server_base.cc:1034] running on GCE node
I20260811 12:39:37.165951 1181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:37.167028 1181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:37.168284 1181 hybrid_clock.cc:648] HybridClock initialized: now 1786451977168242 us; error 54 us; skew 500 ppm
I20260811 12:39:37.168653 1181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:37.172081 1181 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:39:37.173830 1181 webserver.cc:460] Webserver started at http://127.0.186.67:37575/ using document root <none> and password file <none>
I20260811 12:39:37.174506 1181 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:37.174615 1181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:37.174896 1181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:37.178084 1181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "342a1262b0374d44bd2b6dd855bd6471"
format_stamp: "Formatted at 2026-08-11 12:39:37 on dist-test-slave-qg60"
server_key: "a9f7a6c6e4fcade40f5b1504a6663bf3"
server_key_iv: "348a15b1db73666c642613d1c3a2383e"
server_key_version: "encryptionkey@0"
I20260811 12:39:37.178911 1181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "342a1262b0374d44bd2b6dd855bd6471"
format_stamp: "Formatted at 2026-08-11 12:39:37 on dist-test-slave-qg60"
server_key: "a9f7a6c6e4fcade40f5b1504a6663bf3"
server_key_iv: "348a15b1db73666c642613d1c3a2383e"
server_key_version: "encryptionkey@0"
I20260811 12:39:37.184531 1181 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 12:39:37.188318 1198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:37.189908 1181 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:39:37.190090 1181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "342a1262b0374d44bd2b6dd855bd6471"
format_stamp: "Formatted at 2026-08-11 12:39:37 on dist-test-slave-qg60"
server_key: "a9f7a6c6e4fcade40f5b1504a6663bf3"
server_key_iv: "348a15b1db73666c642613d1c3a2383e"
server_key_version: "encryptionkey@0"
I20260811 12:39:37.190318 1181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:37.204646 1181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:37.209442 1181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:37.209867 1181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:37.210950 1181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:37.212322 1181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:37.212396 1181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:37.212482 1181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:37.212539 1181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:37.251093 1181 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:34251
I20260811 12:39:37.251189 1323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:34251 every 8 connection(s)
I20260811 12:39:37.252538 1181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:39:37.262225 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 1181
I20260811 12:39:37.262451 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:39:37.262943 745 external_mini_cluster.cc:1428] Setting key 83dd8cecced687ce25713f2e8c4c11d9
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:37.275333 1326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.255488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:43059 (local address 127.0.186.126:42125)
0811 12:39:37.256065 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:37.256073 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:37.257345 (+ 1272us) server_negotiation.cc:407] Connection header received
0811 12:39:37.259426 (+ 2081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:37.259431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:37.259526 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:37.259636 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:37.261388 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.262290 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.264297 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.264961 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.265116 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.269311 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:37.269316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:37.269320 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:37.269357 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:37.272300 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.273207 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.273211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.273213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.273344 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.273751 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.273754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.273756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.274037 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:37.274168 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:37.274858 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 12:39:37.275051 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":265,"threads_started":1}
I20260811 12:39:37.276381 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.256153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:42125 (local address 127.0.186.67:43059)
0811 12:39:37.257170 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:37.257219 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:37.259095 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:37.259889 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:37.259898 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:37.260469 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:37.261179 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:37.261200 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.262573 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.262582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:37.264151 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:37.264165 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.265190 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.265195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:37.265514 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.266376 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:37.266408 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:37.269085 (+ 2677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:37.272470 (+ 3385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:37.272477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:37.272494 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:37.273077 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:37.273445 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:37.273448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:37.273450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:37.273645 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:37.274149 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:37.274156 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:37.274504 (+ 348us) client_negotiation.cc:769] Sending connection context
0811 12:39:37.274741 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 12:39:37.275192 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":501,"threads_started":1}
I20260811 12:39:37.278187 1324 heartbeater.cc:347] Connected to a master server at 127.0.186.126:42125
I20260811 12:39:37.278627 1324 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:37.279583 1324 heartbeater.cc:511] Master 127.0.186.126:42125 requested a full tablet report, sending...
I20260811 12:39:37.281275 804 ts_manager.cc:194] Registered new tserver with Master: 342a1262b0374d44bd2b6dd855bd6471 (127.0.186.67:34251)
I20260811 12:39:37.282240 804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:43059
I20260811 12:39:37.293502 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:37.349748 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.332224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41748 (local address 127.0.186.65:33387)
0811 12:39:37.333014 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:37.333025 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:37.333076 (+ 51us) server_negotiation.cc:407] Connection header received
0811 12:39:37.333314 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:37.333322 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:37.333558 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:37.333739 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:37.335379 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.336433 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.337874 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.338477 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.338633 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.343411 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:37.343426 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:37.343441 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:37.343484 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:37.346868 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.347612 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.347620 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.347622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.347758 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.348135 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.348139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.348141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.348536 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:37.348870 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:37.349162 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 12:39:37.349398 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":371,"threads_started":1}
W20260811 12:39:37.351251 925 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41748
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:37.405995 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.390736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41756 (local address 127.0.186.65:33387)
0811 12:39:37.391058 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:37.391067 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:37.391232 (+ 165us) server_negotiation.cc:407] Connection header received
0811 12:39:37.391446 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:37.391451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:37.391558 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:37.391663 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:37.393343 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.394153 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.395502 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.395939 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.396047 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.400318 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:37.400323 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:37.400326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:37.400365 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:37.403270 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.403951 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.403955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.403957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.404105 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.404426 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.404429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.404431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.404691 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:37.405056 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:37.405372 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 12:39:37.405656 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260811 12:39:37.407670 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 875
I20260811 12:39:37.422680 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.408724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.0.186.65:33387)
0811 12:39:37.408961 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:37.408969 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:37.409350 (+ 381us) server_negotiation.cc:407] Connection header received
0811 12:39:37.409471 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:37.409475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:37.409552 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:37.409633 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:37.410916 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.411638 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.413565 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.414057 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.414167 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.417060 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:37.417064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:37.417068 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:37.417101 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:37.419814 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.420638 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.420642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.420644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.420852 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.421263 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.421266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.421268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.421579 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:37.421755 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:37.422067 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 12:39:37.422236 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 12:39:37.423538 1015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:37.511438 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 875
I20260811 12:39:37.534178 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 1026
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:39:37.551512 1343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.535283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.0.186.66:44493)
0811 12:39:37.535839 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:37.535846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:37.535874 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:39:37.535945 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:37.535951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:37.536206 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:37.536345 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:37.537646 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.538651 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.539906 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.540460 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.540562 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.545178 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:37.545193 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:37.545208 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:37.545249 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:37.548414 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.549342 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.549349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.549352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.549495 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.549893 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.549896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.549898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.550279 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:37.550510 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:37.550813 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 12:39:37.551111 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":280,"threads_started":1}
I20260811 12:39:37.553102 1167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:37.640836 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 1026
I20260811 12:39:37.663065 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 1181
Aug 11 12:39:37 dist-test-slave-qg60 krb5kdc[752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:39:37.681015 1346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:37.664127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56346 (local address 127.0.186.67:34251)
0811 12:39:37.664936 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:37.664943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:37.664975 (+ 32us) server_negotiation.cc:407] Connection header received
0811 12:39:37.665087 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:37.665094 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:37.665343 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:37.665522 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:37.666907 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.667977 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.669389 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:37.669979 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:37.670130 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:37.674446 (+ 4316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:37.674458 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:37.674472 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:37.674510 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:37.677585 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.678409 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.678426 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.678428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.678603 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:37.679051 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:37.679061 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:37.679063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:37.679447 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:37.679828 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:37.680161 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 12:39:37.680493 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":399,"threads_started":1}
I20260811 12:39:37.682508 1319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:37.767498 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 1181
I20260811 12:39:37.789340 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 767
I20260811 12:39:37.790810 838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:37.902341 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 767
2026-08-11T12:39:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (5141 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:39:38 dist-test-slave-qg60 krb5kdc[1352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:39:38 dist-test-slave-qg60 krb5kdc[1352](info): set up 2 sockets
Aug 11 12:39:38 dist-test-slave-qg60 krb5kdc[1352](info): commencing operation
krb5kdc: starting...
W20260811 12:39:39.134654 745 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:39:39 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:39:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:39:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:39:39.364887 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:41463
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:41463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:39.705976 1368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:39.706295 1368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:39.706387 1368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:39.713747 1368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:39:39.713869 1368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:39.713945 1368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:39.714008 1368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:39:39.714056 1368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:39:39.724247 1368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:41463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:41463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:39.725642 1368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:39.726961 1368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:39.739491 1375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:39.739594 1377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:39.739538 1374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:39.740494 1368 server_base.cc:1034] running on GCE node
I20260811 12:39:39.741429 1368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:39.743008 1368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:39.744234 1368 hybrid_clock.cc:648] HybridClock initialized: now 1786451979744192 us; error 34 us; skew 500 ppm
I20260811 12:39:39.744611 1368 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:39 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451979, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:39.748210 1368 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:39:39.749935 1368 webserver.cc:460] Webserver started at http://127.0.186.126:44933/ using document root <none> and password file <none>
I20260811 12:39:39.750733 1368 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:39.750890 1368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:39.751233 1368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:39.754685 1368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "b420d7a68a6d41bd8bd484b900bc8667"
format_stamp: "Formatted at 2026-08-11 12:39:39 on dist-test-slave-qg60"
server_key: "61a30eaafb8b0e3ebb787a20375117e8"
server_key_iv: "c828dc87a4e7684a5d355b6a8ba91cd6"
server_key_version: "encryptionkey@0"
I20260811 12:39:39.755541 1368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "b420d7a68a6d41bd8bd484b900bc8667"
format_stamp: "Formatted at 2026-08-11 12:39:39 on dist-test-slave-qg60"
server_key: "61a30eaafb8b0e3ebb787a20375117e8"
server_key_iv: "c828dc87a4e7684a5d355b6a8ba91cd6"
server_key_version: "encryptionkey@0"
I20260811 12:39:39.761371 1368 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 12:39:39.765266 1385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:39.766741 1368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:39:39.766948 1368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "b420d7a68a6d41bd8bd484b900bc8667"
format_stamp: "Formatted at 2026-08-11 12:39:39 on dist-test-slave-qg60"
server_key: "61a30eaafb8b0e3ebb787a20375117e8"
server_key_iv: "c828dc87a4e7684a5d355b6a8ba91cd6"
server_key_version: "encryptionkey@0"
I20260811 12:39:39.767171 1368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:39.795639 1368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:39.800360 1368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:39.800686 1368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:39.820605 1368 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:41463
I20260811 12:39:39.820655 1442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:41463 every 8 connection(s)
I20260811 12:39:39.822053 1368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:39:39.825884 1443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:39.827453 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 1368
I20260811 12:39:39.827728 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:39:39.828380 745 external_mini_cluster.cc:1428] Setting key 4b892480d1a124149152500a1d7b3dc2
I20260811 12:39:39.838850 1443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667: Bootstrap starting.
I20260811 12:39:39.843197 1443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667: Neither blocks nor log segments found. Creating new log.
Aug 11 12:39:39 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:39.844496 1443 log.cc:824] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:39.847694 1443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667: No bootstrap required, opened a new log
I20260811 12:39:39.853163 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:39.830548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47958 (local address 127.0.186.126:41463)
0811 12:39:39.831399 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:39.831414 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:39.831456 (+ 42us) server_negotiation.cc:407] Connection header received
0811 12:39:39.833323 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:39.833347 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:39.833757 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:39.834092 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:39.836084 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:39.837653 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:39.839509 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:39.840199 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:39.840334 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:39.845334 (+ 5000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:39.845343 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:39.845358 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:39.845402 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:39.848821 (+ 3419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:39.849542 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:39.849557 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:39.849564 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:39.849753 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:39.850157 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:39.850168 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:39.850171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:39.850735 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:39.851070 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:39.851579 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 12:39:39.852009 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":405,"threads_started":1}
I20260811 12:39:39.856472 1443 raft_consensus.cc:348] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b420d7a68a6d41bd8bd484b900bc8667" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41463 } }
I20260811 12:39:39.856925 1443 raft_consensus.cc:374] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:39.857036 1443 raft_consensus.cc:729] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b420d7a68a6d41bd8bd484b900bc8667, State: Initialized, Role: FOLLOWER
I20260811 12:39:39.857658 1443 consensus_queue.cc:260] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b420d7a68a6d41bd8bd484b900bc8667" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41463 } }
I20260811 12:39:39.857923 1443 raft_consensus.cc:388] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:39:39.858071 1443 raft_consensus.cc:482] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:39:39.858258 1443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:39.860863 1443 raft_consensus.cc:504] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b420d7a68a6d41bd8bd484b900bc8667" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41463 } }
I20260811 12:39:39.861385 1443 leader_election.cc:302] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b420d7a68a6d41bd8bd484b900bc8667; no voters:
I20260811 12:39:39.861969 1443 leader_election.cc:288] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:39:39.862128 1449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:39.863418 1449 raft_consensus.cc:686] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [term 1 LEADER]: Becoming Leader. State: Replica: b420d7a68a6d41bd8bd484b900bc8667, State: Running, Role: LEADER
I20260811 12:39:39.864032 1449 consensus_queue.cc:237] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b420d7a68a6d41bd8bd484b900bc8667" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41463 } }
I20260811 12:39:39.864336 1443 sys_catalog.cc:564] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:39:39.867367 1450 sys_catalog.cc:455] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b420d7a68a6d41bd8bd484b900bc8667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b420d7a68a6d41bd8bd484b900bc8667" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41463 } } }
I20260811 12:39:39.867691 1451 sys_catalog.cc:455] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b420d7a68a6d41bd8bd484b900bc8667. Latest consensus state: current_term: 1 leader_uuid: "b420d7a68a6d41bd8bd484b900bc8667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b420d7a68a6d41bd8bd484b900bc8667" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41463 } } }
I20260811 12:39:39.868072 1450 sys_catalog.cc:458] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:39.868099 1451 sys_catalog.cc:458] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667 [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:39.869134 1456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:39:39.876245 1456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:39:39.890394 1456 catalog_manager.cc:1347] Generated new cluster ID: b83969cdd4ce49acbec8a275fc87761c
I20260811 12:39:39.890592 1456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:39:39.900245 1456 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:39:39.901619 1456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:39:39.907343 1456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b420d7a68a6d41bd8bd484b900bc8667: Generated new TSK 0
I20260811 12:39:39.908330 1456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:39:39.978018 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41463
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:40.351575 1472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:40.351895 1472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:40.352083 1472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:40.359812 1472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:40.359957 1472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:40.360143 1472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:39:40.371098 1472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:40.372641 1472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:40.374255 1472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:40.388340 1480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:40.388522 1478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:40.388305 1482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:40.389142 1472 server_base.cc:1034] running on GCE node
I20260811 12:39:40.389899 1472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:40.390939 1472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:40.392163 1472 hybrid_clock.cc:648] HybridClock initialized: now 1786451980392120 us; error 33 us; skew 500 ppm
I20260811 12:39:40.392524 1472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:40 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451980, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:40.396374 1472 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:39:40.398098 1472 webserver.cc:460] Webserver started at http://127.0.186.65:33447/ using document root <none> and password file <none>
I20260811 12:39:40.398844 1472 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:40.398988 1472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:40.399329 1472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:40.402545 1472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "588458c9e568433396c410dc6bfc46f7"
format_stamp: "Formatted at 2026-08-11 12:39:40 on dist-test-slave-qg60"
server_key: "70de66b519de4dc69f389b22f11d9fa9"
server_key_iv: "dfd9733fe949903279c595c7981bf449"
server_key_version: "encryptionkey@0"
I20260811 12:39:40.403451 1472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "588458c9e568433396c410dc6bfc46f7"
format_stamp: "Formatted at 2026-08-11 12:39:40 on dist-test-slave-qg60"
server_key: "70de66b519de4dc69f389b22f11d9fa9"
server_key_iv: "dfd9733fe949903279c595c7981bf449"
server_key_version: "encryptionkey@0"
I20260811 12:39:40.409622 1472 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 12:39:40.413357 1490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:40.414928 1472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 12:39:40.415139 1472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "588458c9e568433396c410dc6bfc46f7"
format_stamp: "Formatted at 2026-08-11 12:39:40 on dist-test-slave-qg60"
server_key: "70de66b519de4dc69f389b22f11d9fa9"
server_key_iv: "dfd9733fe949903279c595c7981bf449"
server_key_version: "encryptionkey@0"
I20260811 12:39:40.415372 1472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:40.442327 1472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:40.447125 1472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:40.447461 1472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:40.448576 1472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:40.450254 1472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:40.450335 1472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:40.450465 1472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:40.450532 1472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:40.487823 1472 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:36319
I20260811 12:39:40.487869 1619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:36319 every 8 connection(s)
I20260811 12:39:40.489204 1472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:39:40.495425 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 1472
I20260811 12:39:40.495673 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:39:40.496510 745 external_mini_cluster.cc:1428] Setting key 5af44c9f33f467ecb512b108db37b583
Aug 11 12:39:40 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451980, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:40.514210 1623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:40.492079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:35257 (local address 127.0.186.126:41463)
0811 12:39:40.492927 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:40.492934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:40.493888 (+ 954us) server_negotiation.cc:407] Connection header received
0811 12:39:40.496543 (+ 2655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:40.496550 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:40.496674 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:40.496833 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:40.498961 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:40.499708 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:40.502398 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:40.502830 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:40.502939 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:40.507683 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:40.507694 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:40.507702 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:40.507752 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:40.510598 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:40.511666 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:40.511670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:40.511672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:40.511801 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:40.512346 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:40.512349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:40.512351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:40.512618 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:40.512780 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:40.513739 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 12:39:40.513927 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":366,"threads_started":1}
I20260811 12:39:40.515946 1625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:40.492632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41463 (local address 127.0.186.65:35257)
0811 12:39:40.493699 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:40.493752 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:40.496139 (+ 2387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:40.497159 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:40.497172 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:40.497960 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:40.498772 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:40.498801 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:40.499876 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:40.499884 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:40.502211 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:40.502234 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:40.503095 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:40.503106 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:40.503470 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:40.504282 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:40.504319 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:40.507390 (+ 3071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:40.510775 (+ 3385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:40.510795 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:40.510817 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:40.511526 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:40.511924 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:40.511931 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:40.511937 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:40.512220 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:40.512791 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:40.512802 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:40.513306 (+ 504us) client_negotiation.cc:769] Sending connection context
0811 12:39:40.513636 (+ 330us) client_negotiation.cc:240] Negotiation successful
0811 12:39:40.514287 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":366,"threads_started":1}
I20260811 12:39:40.517750 1620 heartbeater.cc:347] Connected to a master server at 127.0.186.126:41463
I20260811 12:39:40.518106 1620 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:40.518944 1620 heartbeater.cc:511] Master 127.0.186.126:41463 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
I20260811 12:39:40.521529 1403 ts_manager.cc:194] Registered new tserver with Master: 588458c9e568433396c410dc6bfc46f7 (127.0.186.65:36319)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
I20260811 12:39:40.523069 1403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:35257
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:39:40.552222 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41463
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:40.905575 1628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:40.905932 1628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:40.906116 1628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:40.913928 1628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:40.914094 1628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:40.914294 1628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:39:40.925027 1628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:40.926442 1628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:40.927881 1628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:40.942860 1634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:40.942894 1633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:40.942817 1637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:40.943710 1628 server_base.cc:1034] running on GCE node
I20260811 12:39:40.944404 1628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:40.945513 1628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:40.946722 1628 hybrid_clock.cc:648] HybridClock initialized: now 1786451980946656 us; error 60 us; skew 500 ppm
I20260811 12:39:40.947113 1628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:40 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451980, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:40.950644 1628 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:39:40.952275 1628 webserver.cc:460] Webserver started at http://127.0.186.66:36331/ using document root <none> and password file <none>
I20260811 12:39:40.953128 1628 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:40.953240 1628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:40.953575 1628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:40.956678 1628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "adbee8e14e6841d5b8384d20bd2f9775"
format_stamp: "Formatted at 2026-08-11 12:39:40 on dist-test-slave-qg60"
server_key: "31dfa02bebaad1abb64c82d131eadd09"
server_key_iv: "1a3bad4a871e5c8958aab1a6cfd7ade9"
server_key_version: "encryptionkey@0"
I20260811 12:39:40.957532 1628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "adbee8e14e6841d5b8384d20bd2f9775"
format_stamp: "Formatted at 2026-08-11 12:39:40 on dist-test-slave-qg60"
server_key: "31dfa02bebaad1abb64c82d131eadd09"
server_key_iv: "1a3bad4a871e5c8958aab1a6cfd7ade9"
server_key_version: "encryptionkey@0"
I20260811 12:39:40.962850 1628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:39:40.966588 1647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:40.968180 1628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:40.968405 1628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "adbee8e14e6841d5b8384d20bd2f9775"
format_stamp: "Formatted at 2026-08-11 12:39:40 on dist-test-slave-qg60"
server_key: "31dfa02bebaad1abb64c82d131eadd09"
server_key_iv: "1a3bad4a871e5c8958aab1a6cfd7ade9"
server_key_version: "encryptionkey@0"
I20260811 12:39:40.968662 1628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:40.987325 1628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:40.993006 1628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:40.993304 1628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:40.994427 1628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:40.996178 1628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:40.996315 1628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:40.996511 1628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:40.996601 1628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:41.034410 1628 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:36659
I20260811 12:39:41.034507 1773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:36659 every 8 connection(s)
I20260811 12:39:41.035808 1628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:39:41.046104 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 1628
I20260811 12:39:41.046339 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:39:41.046902 745 external_mini_cluster.cc:1428] Setting key 1bf58a01c180fb819c66a8fb1bc0f723
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451980, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:41.060174 1776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.038809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:41505 (local address 127.0.186.126:41463)
0811 12:39:41.039320 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.039324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.040426 (+ 1102us) server_negotiation.cc:407] Connection header received
0811 12:39:41.042555 (+ 2129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.042561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.042640 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.042754 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.044486 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.045377 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.047842 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.048477 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.048611 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.053342 (+ 4731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.053351 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.053358 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.053405 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.056719 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.057670 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.057676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.057679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.057824 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.058297 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.058303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.058306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.058620 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.058788 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.059516 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.059747 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":253,"threads_started":1}
I20260811 12:39:41.061576 1777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.039441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41463 (local address 127.0.186.66:41505)
0811 12:39:41.040241 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.040281 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.042229 (+ 1948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.043022 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.043043 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.043615 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:41.044274 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.044293 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.045577 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.045581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.047657 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.047671 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.048707 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.048712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.049131 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.049870 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:41.049904 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:41.053005 (+ 3101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:41.056924 (+ 3919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:41.056934 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:41.056953 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:41.057511 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:41.057948 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:41.057953 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:41.057957 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:41.058177 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:41.058758 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:41.058766 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:41.059142 (+ 376us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.059434 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.060046 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":297,"threads_started":1}
I20260811 12:39:41.063362 1774 heartbeater.cc:347] Connected to a master server at 127.0.186.126:41463
I20260811 12:39:41.063758 1774 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:41.064798 1774 heartbeater.cc:511] Master 127.0.186.126:41463 requested a full tablet report, sending...
I20260811 12:39:41.066727 1403 ts_manager.cc:194] Registered new tserver with Master: adbee8e14e6841d5b8384d20bd2f9775 (127.0.186.66:36659)
I20260811 12:39:41.067659 1403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:41505
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:39:41.101321 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41463
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:41.468802 1781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:41.469290 1781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:41.469470 1781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:41.477293 1781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:41.477412 1781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:41.477536 1781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:39:41.487624 1781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:41.489002 1781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:41.490432 1781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:41.505743 1786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:41.505774 1787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:41.505860 1791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:41.506942 1781 server_base.cc:1034] running on GCE node
I20260811 12:39:41.507676 1781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:41.508790 1781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:41.510031 1781 hybrid_clock.cc:648] HybridClock initialized: now 1786451981509975 us; error 48 us; skew 500 ppm
I20260811 12:39:41.510404 1781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:41.513880 1781 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:39:41.515431 1781 webserver.cc:460] Webserver started at http://127.0.186.67:38071/ using document root <none> and password file <none>
I20260811 12:39:41.516217 1781 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:41.516372 1781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:41.516775 1781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:41.520145 1781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "fc08bb4f8d3e4ec99cdc39645321e02c"
format_stamp: "Formatted at 2026-08-11 12:39:41 on dist-test-slave-qg60"
server_key: "bbc89afb458d992c250e780f14650d99"
server_key_iv: "37d6dd55527289961718f44ac8681a04"
server_key_version: "encryptionkey@0"
I20260811 12:39:41.521042 1781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "fc08bb4f8d3e4ec99cdc39645321e02c"
format_stamp: "Formatted at 2026-08-11 12:39:41 on dist-test-slave-qg60"
server_key: "bbc89afb458d992c250e780f14650d99"
server_key_iv: "37d6dd55527289961718f44ac8681a04"
server_key_version: "encryptionkey@0"
I20260811 12:39:41.526561 1620 heartbeater.cc:503] Master 127.0.186.126:41463 was elected leader, sending a full tablet report...
I20260811 12:39:41.526681 1781 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:39:41.530730 1799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:41.532130 1781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:39:41.532310 1781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "fc08bb4f8d3e4ec99cdc39645321e02c"
format_stamp: "Formatted at 2026-08-11 12:39:41 on dist-test-slave-qg60"
server_key: "bbc89afb458d992c250e780f14650d99"
server_key_iv: "37d6dd55527289961718f44ac8681a04"
server_key_version: "encryptionkey@0"
I20260811 12:39:41.532569 1781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:41.549949 1781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:41.555209 1781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:41.555558 1781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:41.556929 1781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:41.558595 1781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:41.558713 1781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:41.558887 1781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:41.559106 1781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:41.597885 1781 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:39313
I20260811 12:39:41.597945 1936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:39313 every 8 connection(s)
I20260811 12:39:41.599246 1781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:39:41.605274 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 1781
I20260811 12:39:41.605509 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:39:41.606091 745 external_mini_cluster.cc:1428] Setting key 91e2b0d16fa7b3060f2452253e4f27b3
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:41.622332 1939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.602062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:42795 (local address 127.0.186.126:41463)
0811 12:39:41.602592 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.602597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.603434 (+ 837us) server_negotiation.cc:407] Connection header received
0811 12:39:41.605719 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.605724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.605797 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.605897 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.608089 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.609543 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.611266 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.611695 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.611798 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.615385 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.615390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.615393 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.615428 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.618371 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.619235 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.619239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.619242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.619379 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.620097 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.620105 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.620109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.620546 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.620786 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.621684 (+ 898us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.621963 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":273,"threads_started":1}
I20260811 12:39:41.623472 1940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.602490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41463 (local address 127.0.186.67:42795)
0811 12:39:41.603260 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.603305 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.605397 (+ 2092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.606201 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.606213 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.606943 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:41.607778 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.607805 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.609753 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.609759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.611111 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.611124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.611898 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.611902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.612154 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.612872 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:41.612896 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:41.615173 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:41.618532 (+ 3359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:41.618541 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:41.618555 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:41.619116 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:41.619532 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:41.619536 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:41.619539 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:41.619794 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:41.620718 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:41.620746 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:41.621219 (+ 473us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.621559 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.622172 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":291,"threads_started":1}
I20260811 12:39:41.625280 1937 heartbeater.cc:347] Connected to a master server at 127.0.186.126:41463
I20260811 12:39:41.625638 1937 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:41.626534 1937 heartbeater.cc:511] Master 127.0.186.126:41463 requested a full tablet report, sending...
I20260811 12:39:41.628118 1403 ts_manager.cc:194] Registered new tserver with Master: fc08bb4f8d3e4ec99cdc39645321e02c (127.0.186.67:39313)
I20260811 12:39:41.629195 1403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:42795
I20260811 12:39:41.635092 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:39:41.655910 1939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.642034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47970 (local address 127.0.186.126:41463)
0811 12:39:41.642237 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.642242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.642691 (+ 449us) server_negotiation.cc:407] Connection header received
0811 12:39:41.642842 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.642846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.642918 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.643076 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.644713 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.645698 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.647047 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.647498 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.647613 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.650184 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.650189 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.650192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.650226 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.653213 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.653897 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.653901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.653903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.654029 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.654431 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.654437 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.654439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.654854 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.655094 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.655453 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.655661 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 12:39:41.663121 1403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:41.670836 1403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:41.697221 1950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.685211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:36319 (local address 127.0.0.1:34910)
0811 12:39:41.686000 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.686044 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.686235 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.688606 (+ 2371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.688613 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.688645 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:41.689217 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.689233 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.691616 (+ 2383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.691622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.694223 (+ 2601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.694238 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.696074 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.696080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.696265 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.696326 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.696491 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.696705 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"mutex_wait_us":62,"thread_start_us":357,"threads_started":1}
I20260811 12:39:41.697510 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.687566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:39313 (local address 127.0.0.1:53202)
0811 12:39:41.688145 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.688162 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.688274 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.690169 (+ 1895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.690173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.690199 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:41.690639 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.690650 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.692259 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.692264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.694829 (+ 2565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.694841 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.696517 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.696523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.696695 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.696753 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.696845 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.696996 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":192,"thread_start_us":323,"threads_started":1}
I20260811 12:39:41.698225 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.687946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.0.186.67:39313)
0811 12:39:41.689321 (+ 1375us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.689329 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.689362 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:39:41.689457 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.689464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.689670 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.689867 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:41.690819 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.692094 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.695003 (+ 2909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.695971 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.696114 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.696336 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.696925 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.697129 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1207,"thread_start_us":1028,"threads_started":1}
I20260811 12:39:41.698446 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.687017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32798 (local address 127.0.186.66:36659)
0811 12:39:41.688819 (+ 1802us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.688830 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.688860 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:39:41.688976 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.688984 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.689216 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.689430 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:41.690443 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.691844 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.694883 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.696382 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.696547 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.696734 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.697918 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.698123 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1601,"thread_start_us":1451,"threads_started":1}
I20260811 12:39:41.698735 1952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.686470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:36659 (local address 127.0.0.1:32798)
0811 12:39:41.687072 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.687090 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.687223 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.689680 (+ 2457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.689685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.689709 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:41.690180 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.690194 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.691988 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.691994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.694680 (+ 2686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.694710 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.696621 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.696628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.696918 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.696953 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.697048 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.697185 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":105,"thread_start_us":760,"threads_started":1}
I20260811 12:39:41.699397 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.685586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34910 (local address 127.0.186.65:36319)
0811 12:39:41.687830 (+ 2244us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.687842 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.687877 (+ 35us) server_negotiation.cc:407] Connection header received
0811 12:39:41.688014 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.688025 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.688302 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.689473 (+ 1171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:41.689703 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.691449 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.694402 (+ 2953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.695833 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.695996 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.696262 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.698977 (+ 2715us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.699126 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2057,"thread_start_us":1902,"threads_started":1}
I20260811 12:39:41.702392 1704 tablet_service.cc:1467] Processing CreateTablet for tablet 74c2c06a7c7f47d2a61e20568086fdc1 (DEFAULT_TABLE table=test-table [id=327ddad97df4442a8e7447e6401ca922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:41.702590 1859 tablet_service.cc:1467] Processing CreateTablet for tablet 74c2c06a7c7f47d2a61e20568086fdc1 (DEFAULT_TABLE table=test-table [id=327ddad97df4442a8e7447e6401ca922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:41.702921 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 74c2c06a7c7f47d2a61e20568086fdc1 (DEFAULT_TABLE table=test-table [id=327ddad97df4442a8e7447e6401ca922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:41.704116 1704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74c2c06a7c7f47d2a61e20568086fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:41.704154 1859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74c2c06a7c7f47d2a61e20568086fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:41.704177 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74c2c06a7c7f47d2a61e20568086fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:41.715934 1956 tablet_bootstrap.cc:492] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: Bootstrap starting.
I20260811 12:39:41.720472 1960 tablet_bootstrap.cc:492] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: Bootstrap starting.
I20260811 12:39:41.720760 1957 tablet_bootstrap.cc:492] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: Bootstrap starting.
I20260811 12:39:41.721277 1956 tablet_bootstrap.cc:654] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:41.722700 1956 log.cc:824] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:41.723819 1957 tablet_bootstrap.cc:654] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:41.724175 1960 tablet_bootstrap.cc:654] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:41.725217 1957 log.cc:824] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:41.725283 1960 log.cc:824] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:41.726545 1956 tablet_bootstrap.cc:492] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: No bootstrap required, opened a new log
I20260811 12:39:41.727005 1956 ts_tablet_manager.cc:1397] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 12:39:41.729799 1957 tablet_bootstrap.cc:492] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: No bootstrap required, opened a new log
I20260811 12:39:41.729856 1960 tablet_bootstrap.cc:492] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: No bootstrap required, opened a new log
I20260811 12:39:41.730118 1960 ts_tablet_manager.cc:1397] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 12:39:41.730110 1957 ts_tablet_manager.cc:1397] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 12:39:41.734921 1956 raft_consensus.cc:348] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.735363 1956 raft_consensus.cc:374] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:41.735500 1956 raft_consensus.cc:729] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adbee8e14e6841d5b8384d20bd2f9775, State: Initialized, Role: FOLLOWER
I20260811 12:39:41.736240 1956 consensus_queue.cc:260] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.739172 1774 heartbeater.cc:503] Master 127.0.186.126:41463 was elected leader, sending a full tablet report...
I20260811 12:39:41.741308 1956 ts_tablet_manager.cc:1428] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20260811 12:39:41.741470 1957 raft_consensus.cc:348] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.741947 1957 raft_consensus.cc:374] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:41.742079 1957 raft_consensus.cc:729] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588458c9e568433396c410dc6bfc46f7, State: Initialized, Role: FOLLOWER
I20260811 12:39:41.742453 1960 raft_consensus.cc:348] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.742911 1960 raft_consensus.cc:374] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:41.743038 1960 raft_consensus.cc:729] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc08bb4f8d3e4ec99cdc39645321e02c, State: Initialized, Role: FOLLOWER
I20260811 12:39:41.742879 1957 consensus_queue.cc:260] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.743821 1960 consensus_queue.cc:260] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.745189 1957 ts_tablet_manager.cc:1428] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 12:39:41.747248 1937 heartbeater.cc:503] Master 127.0.186.126:41463 was elected leader, sending a full tablet report...
I20260811 12:39:41.747857 1960 ts_tablet_manager.cc:1428] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: Time spent starting tablet: real 0.018s user 0.014s sys 0.003s
I20260811 12:39:41.788055 1966 raft_consensus.cc:482] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 12:39:41.788148 1775 tablet.cc:2369] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:41.788383 1966 raft_consensus.cc:504] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.790289 1966 leader_election.cc:288] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 588458c9e568433396c410dc6bfc46f7 (127.0.186.65:36319), adbee8e14e6841d5b8384d20bd2f9775 (127.0.186.66:36659)
I20260811 12:39:41.796334 1940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.790676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:36319 (local address 127.0.186.67:36177)
0811 12:39:41.790924 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.790942 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.791042 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.791469 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.791474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.791504 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:41.791763 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.791780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.792916 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.792927 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.794525 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.794540 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.795685 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.795691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.795919 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.795943 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.796024 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.796117 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":24}
I20260811 12:39:41.796492 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.790779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:36177 (local address 127.0.186.65:36319)
0811 12:39:41.791025 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.791032 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.791054 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:39:41.791209 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.791215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.791300 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.791406 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:41.791948 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.792704 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.794692 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.795508 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.795646 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.795700 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.796095 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.796238 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 12:39:41.797669 1572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74c2c06a7c7f47d2a61e20568086fdc1" candidate_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588458c9e568433396c410dc6bfc46f7" is_pre_election: true
I20260811 12:39:41.798195 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.791340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:46609 (local address 127.0.186.66:36659)
0811 12:39:41.791569 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.791575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.792173 (+ 598us) server_negotiation.cc:407] Connection header received
0811 12:39:41.792362 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.792366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.792424 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.792520 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:41.793216 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.793950 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.795885 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.797208 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.797328 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.797380 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.797825 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.797925 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 12:39:41.798331 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.791217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:36659 (local address 127.0.186.67:46609)
0811 12:39:41.792070 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:41.792084 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:41.792218 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:41.792544 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:41.792548 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:41.792573 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:41.793053 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.793064 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.794110 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.794116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.795725 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:41.795739 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.797415 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.797421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:41.797633 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.797678 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 12:39:41.797784 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 12:39:41.797936 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":1,"thread_start_us":532,"threads_started":1}
I20260811 12:39:41.798364 1572 raft_consensus.cc:2454] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc08bb4f8d3e4ec99cdc39645321e02c in term 0.
I20260811 12:39:41.799141 1800 leader_election.cc:302] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588458c9e568433396c410dc6bfc46f7, fc08bb4f8d3e4ec99cdc39645321e02c; no voters:
I20260811 12:39:41.799295 1727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74c2c06a7c7f47d2a61e20568086fdc1" candidate_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adbee8e14e6841d5b8384d20bd2f9775" is_pre_election: true
I20260811 12:39:41.799567 1966 raft_consensus.cc:2781] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:41.799726 1966 raft_consensus.cc:482] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:41.799846 1966 raft_consensus.cc:3037] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:41.800006 1727 raft_consensus.cc:2454] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc08bb4f8d3e4ec99cdc39645321e02c in term 0.
I20260811 12:39:41.802371 1966 raft_consensus.cc:504] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.802919 1966 leader_election.cc:288] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [CANDIDATE]: Term 1 election: Requested vote from peers 588458c9e568433396c410dc6bfc46f7 (127.0.186.65:36319), adbee8e14e6841d5b8384d20bd2f9775 (127.0.186.66:36659)
I20260811 12:39:41.803486 1572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74c2c06a7c7f47d2a61e20568086fdc1" candidate_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588458c9e568433396c410dc6bfc46f7"
I20260811 12:39:41.803570 1727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74c2c06a7c7f47d2a61e20568086fdc1" candidate_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adbee8e14e6841d5b8384d20bd2f9775"
I20260811 12:39:41.803725 1572 raft_consensus.cc:3037] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:41.803771 1727 raft_consensus.cc:3037] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:41.807181 1572 raft_consensus.cc:2454] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc08bb4f8d3e4ec99cdc39645321e02c in term 1.
I20260811 12:39:41.807181 1727 raft_consensus.cc:2454] T 74c2c06a7c7f47d2a61e20568086fdc1 P adbee8e14e6841d5b8384d20bd2f9775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc08bb4f8d3e4ec99cdc39645321e02c in term 1.
I20260811 12:39:41.807650 1800 leader_election.cc:302] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adbee8e14e6841d5b8384d20bd2f9775, fc08bb4f8d3e4ec99cdc39645321e02c; no voters:
I20260811 12:39:41.808020 1966 raft_consensus.cc:2781] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:41.808494 1966 raft_consensus.cc:686] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [term 1 LEADER]: Becoming Leader. State: Replica: fc08bb4f8d3e4ec99cdc39645321e02c, State: Running, Role: LEADER
I20260811 12:39:41.809082 1966 consensus_queue.cc:237] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } }
I20260811 12:39:41.814119 1402 catalog_manager.cc:5495] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c reported cstate change: term changed from 0 to 1, leader changed from <none> to fc08bb4f8d3e4ec99cdc39645321e02c (127.0.186.67). New cstate: current_term: 1 leader_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "588458c9e568433396c410dc6bfc46f7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adbee8e14e6841d5b8384d20bd2f9775" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc08bb4f8d3e4ec99cdc39645321e02c" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39313 } health_report { overall_health: HEALTHY } } }
W20260811 12:39:41.851102 1938 tablet.cc:2369] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:41.861078 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.844705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.0.186.65:36319)
0811 12:39:41.844949 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.844955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.845523 (+ 568us) server_negotiation.cc:407] Connection header received
0811 12:39:41.845756 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.845761 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.845831 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.845951 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.847625 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.848423 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.849797 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.850248 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.850408 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.855064 (+ 4656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.855085 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.855100 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.855143 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.858119 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.858851 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.858859 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.858861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.859021 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.859432 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.859436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.859438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.859818 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.860149 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.860454 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.860682 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:41.917783 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.902035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34936 (local address 127.0.186.65:36319)
0811 12:39:41.902306 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.902315 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.902703 (+ 388us) server_negotiation.cc:407] Connection header received
0811 12:39:41.902938 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.902945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.903048 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.903164 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.904642 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.905518 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.906854 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.907322 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.907480 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.912296 (+ 4816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.912302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.912306 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.912343 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.915211 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.915891 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.915903 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.915906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.916072 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.916424 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.916427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.916429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.916700 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.917061 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.917343 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.917533 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 12:39:41 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:41.974148 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.959187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.0.186.65:36319)
0811 12:39:41.959549 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.959559 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.959708 (+ 149us) server_negotiation.cc:407] Connection header received
0811 12:39:41.959864 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.959869 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.959944 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.960042 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.961608 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.962324 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.963642 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.964091 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.964189 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.968468 (+ 4279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.968473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.968476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.968516 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.971238 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.971956 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.971963 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.971966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.972102 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.972492 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.972497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.972500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.972926 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.973191 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.973553 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.973782 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
W20260811 12:39:41.976090 1524 tablet_service.cc:2908] Rejecting scan request for tablet 74c2c06a7c7f47d2a61e20568086fdc1: Uninitialized: clean time has not yet been initialized
I20260811 12:39:41.979426 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 1472
W20260811 12:39:41.992152 1622 tablet.cc:2369] T 74c2c06a7c7f47d2a61e20568086fdc1 P 588458c9e568433396c410dc6bfc46f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:41.993729 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:41.981130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34952 (local address 127.0.186.65:36319)
0811 12:39:41.981350 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:41.981356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:41.981559 (+ 203us) server_negotiation.cc:407] Connection header received
0811 12:39:41.981701 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:41.981705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:41.981792 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:41.981877 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:41.983135 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.983830 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.985127 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:41.985584 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:41.985698 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:41.987964 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:41.987969 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:41.987973 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:41.988005 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:41.990792 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.991425 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.991429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.991431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.991553 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:41.992083 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:41.992088 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:41.992091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:41.992589 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:41.992949 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:41.993182 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 12:39:41.993362 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 12:39:41.994481 1614 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:42.096490 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 1472
I20260811 12:39:42.121078 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 1628
Aug 11 12:39:42 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:39:42.137096 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:42.122030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32804 (local address 127.0.186.66:36659)
0811 12:39:42.122229 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:42.122238 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:42.122266 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:39:42.122499 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:42.122504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:42.122616 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:42.122733 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:42.124046 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:42.124935 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:42.126289 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:42.126718 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:42.126866 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:42.131159 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:42.131177 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:42.131194 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:42.131235 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:42.134240 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:42.134923 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:42.134929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:42.134931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:42.135095 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:42.135420 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:42.135423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:42.135425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:42.135913 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:42.136177 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:42.136449 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 12:39:42.136627 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 12:39:42.137953 1769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:42.230222 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 1628
I20260811 12:39:42.254860 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 1781
Aug 11 12:39:42 dist-test-slave-qg60 krb5kdc[1352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:39:42.265482 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:42.264913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:36319 (local address 127.0.186.67:32975)
0811 12:39:42.265088 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:42.265282 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 12:39:42.265853 1800 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.65:36319: connect: Connection refused (error 111)
I20260811 12:39:42.267557 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:42.267144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:36319 (local address 127.0.186.67:59505)
0811 12:39:42.267315 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:42.267416 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 12:39:42.267881 1800 consensus_peers.cc:487] T 74c2c06a7c7f47d2a61e20568086fdc1 P fc08bb4f8d3e4ec99cdc39645321e02c -> Peer 588458c9e568433396c410dc6bfc46f7 (127.0.186.65:36319): Couldn't send request to peer 588458c9e568433396c410dc6bfc46f7. Status: Network error: Client connection negotiation failed: client connection to 127.0.186.65:36319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 12:39:42.271663 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:42.255689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53218 (local address 127.0.186.67:39313)
0811 12:39:42.256259 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:42.256263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:42.256281 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:39:42.256336 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:42.256340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:42.256399 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:42.256508 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:42.258025 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:42.258769 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:42.260104 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:42.260504 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:42.260616 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:42.265322 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:42.265337 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:42.265355 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:42.265397 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:42.268942 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:42.269674 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:42.269681 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:42.269683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:42.269824 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:42.270206 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:42.270214 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:42.270216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:42.270585 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:42.270807 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:42.271180 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 12:39:42.271376 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":325,"threads_started":1}
I20260811 12:39:42.272418 1930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:42.364825 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 1781
I20260811 12:39:42.387876 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 1368
I20260811 12:39:42.389186 1438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:42.503593 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 1368
2026-08-11T12:39:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4600 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:39:42 dist-test-slave-qg60 krb5kdc[1993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:39:42 dist-test-slave-qg60 krb5kdc[1993](info): set up 2 sockets
Aug 11 12:39:42 dist-test-slave-qg60 krb5kdc[1993](info): commencing operation
krb5kdc: starting...
W20260811 12:39:43.721724 745 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:39:43 dist-test-slave-qg60 krb5kdc[1993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:39:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:39:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:39:43.962900 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34101
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:34101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:44.310168 2009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:44.310472 2009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:44.310634 2009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:44.318113 2009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:39:44.318235 2009 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 12:39:44.318310 2009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:44.318413 2009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:44.318490 2009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:39:44.318573 2009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:39:44.329071 2009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:34101
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:44.330518 2009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:44.331986 2009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:44.345109 2016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:44.345064 2017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:44.345160 2020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:44.346050 2009 server_base.cc:1034] running on GCE node
I20260811 12:39:44.346885 2009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:44.348367 2009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:44.349610 2009 hybrid_clock.cc:648] HybridClock initialized: now 1786451984349505 us; error 69 us; skew 500 ppm
I20260811 12:39:44.350066 2009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:44 dist-test-slave-qg60 krb5kdc[1993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:44.353645 2009 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:39:44.355293 2009 webserver.cc:460] Webserver started at http://127.0.186.126:41049/ using document root <none> and password file <none>
I20260811 12:39:44.356036 2009 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:44.356158 2009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:44.356549 2009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:44.359860 2009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d"
format_stamp: "Formatted at 2026-08-11 12:39:44 on dist-test-slave-qg60"
server_key: "eb70c01948bb1940482395288e9775eb"
server_key_iv: "af7e53eb0e79af5acd1b1a456ba84ff8"
server_key_version: "encryptionkey@0"
I20260811 12:39:44.360777 2009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d"
format_stamp: "Formatted at 2026-08-11 12:39:44 on dist-test-slave-qg60"
server_key: "eb70c01948bb1940482395288e9775eb"
server_key_iv: "af7e53eb0e79af5acd1b1a456ba84ff8"
server_key_version: "encryptionkey@0"
I20260811 12:39:44.366245 2009 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:39:44.370106 2027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:44.371640 2009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:39:44.371847 2009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d"
format_stamp: "Formatted at 2026-08-11 12:39:44 on dist-test-slave-qg60"
server_key: "eb70c01948bb1940482395288e9775eb"
server_key_iv: "af7e53eb0e79af5acd1b1a456ba84ff8"
server_key_version: "encryptionkey@0"
I20260811 12:39:44.372115 2009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:44.388041 2009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:44.393370 2009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:44.393695 2009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:44.417992 2009 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:34101
I20260811 12:39:44.418018 2095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:34101 every 8 connection(s)
I20260811 12:39:44.419463 2009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:39:44.423619 2096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:44.426970 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 2009
I20260811 12:39:44.427269 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:39:44.428015 745 external_mini_cluster.cc:1428] Setting key c15aea336291336a6209bf02a4bd5fc1
I20260811 12:39:44.435400 2096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: Bootstrap starting.
I20260811 12:39:44.439422 2096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:44.440644 2096 log.cc:824] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:44.443560 2096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: No bootstrap required, opened a new log
Aug 11 12:39:44 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:44.452400 2096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34101 } }
I20260811 12:39:44.452872 2096 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:44.453033 2096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0e2157cb2b4aaa94d19bfc49d42d2d, State: Initialized, Role: FOLLOWER
I20260811 12:39:44.453728 2096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34101 } }
I20260811 12:39:44.454006 2096 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:39:44.454164 2096 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:39:44.454377 2096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:44.454800 2099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:44.430361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.0.186.126:34101)
0811 12:39:44.431355 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:44.431366 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:44.431410 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:39:44.433901 (+ 2491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:44.433924 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:44.434334 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:44.434666 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:44.436652 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:44.438170 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:44.439987 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:44.440785 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:44.441019 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:44.445342 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:44.445350 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:44.445375 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:44.445425 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:44.449451 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:44.450397 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:44.450406 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:44.450413 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:44.450649 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:44.451144 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:44.451154 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:44.451157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:44.451892 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:44.452254 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:44.452812 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 12:39:44.453338 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":461,"threads_started":1}
I20260811 12:39:44.457072 2096 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34101 } }
I20260811 12:39:44.457727 2096 leader_election.cc:302] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d0e2157cb2b4aaa94d19bfc49d42d2d; no voters:
I20260811 12:39:44.458458 2096 leader_election.cc:288] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:39:44.458585 2101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:44.459393 2101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [term 1 LEADER]: Becoming Leader. State: Replica: 5d0e2157cb2b4aaa94d19bfc49d42d2d, State: Running, Role: LEADER
I20260811 12:39:44.460011 2101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34101 } }
I20260811 12:39:44.460685 2096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:39:44.463697 2103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d0e2157cb2b4aaa94d19bfc49d42d2d. Latest consensus state: current_term: 1 leader_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34101 } } }
I20260811 12:39:44.463676 2102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e2157cb2b4aaa94d19bfc49d42d2d" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34101 } } }
I20260811 12:39:44.464251 2103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:44.464304 2102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d [sys.catalog]: This master's current role is: LEADER
W20260811 12:39:44.476091 2119 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:39:44.476265 2119 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:39:44.476392 2107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:39:44.479058 2107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:39:44.488709 2107 catalog_manager.cc:1347] Generated new cluster ID: bf7eba22b358497b9e365533333288fc
I20260811 12:39:44.489071 2107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:39:44.506572 2107 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:39:44.507982 2107 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:39:44.518702 2107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: Generated new TSK 0
I20260811 12:39:44.519632 2107 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:39:44.577610 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34101
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:44.928552 2124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:44.928860 2124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:44.929049 2124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:44.936300 2124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:44.936424 2124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:44.936604 2124 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:39:44.936729 2124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:39:44.947196 2124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:34101
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:44.948632 2124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:44.950158 2124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:44.964423 2134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:44.964564 2132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:44.964545 2131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:44.965662 2124 server_base.cc:1034] running on GCE node
I20260811 12:39:44.966291 2124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:44.967214 2124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:44.968475 2124 hybrid_clock.cc:648] HybridClock initialized: now 1786451984968405 us; error 36 us; skew 500 ppm
I20260811 12:39:44.968852 2124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:44 dist-test-slave-qg60 krb5kdc[1993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:44.972357 2124 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:39:44.974058 2124 webserver.cc:460] Webserver started at http://127.0.186.65:41611/ using document root <none> and password file <none>
I20260811 12:39:44.974779 2124 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:44.974931 2124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:44.975303 2124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:44.978677 2124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "ec4bd099117145a9871fb5dab2590fe6"
format_stamp: "Formatted at 2026-08-11 12:39:44 on dist-test-slave-qg60"
server_key: "d1444e15bcda2818473ad4015763ae77"
server_key_iv: "89736fb8f227f9baa9c30a9df26500d6"
server_key_version: "encryptionkey@0"
I20260811 12:39:44.979545 2124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "ec4bd099117145a9871fb5dab2590fe6"
format_stamp: "Formatted at 2026-08-11 12:39:44 on dist-test-slave-qg60"
server_key: "d1444e15bcda2818473ad4015763ae77"
server_key_iv: "89736fb8f227f9baa9c30a9df26500d6"
server_key_version: "encryptionkey@0"
I20260811 12:39:44.985343 2124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 12:39:44.989179 2141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:44.990710 2124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:39:44.990909 2124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "ec4bd099117145a9871fb5dab2590fe6"
format_stamp: "Formatted at 2026-08-11 12:39:44 on dist-test-slave-qg60"
server_key: "d1444e15bcda2818473ad4015763ae77"
server_key_iv: "89736fb8f227f9baa9c30a9df26500d6"
server_key_version: "encryptionkey@0"
I20260811 12:39:44.991168 2124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:45.007825 2124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:45.012894 2124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:45.013248 2124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:45.016651 2124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:45.016816 2124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 12:39:45.017024 2124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:45.017107 2124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:39:45 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:45.042853 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.017165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:48267 (local address 127.0.186.126:34101)
0811 12:39:45.017775 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:45.017784 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:45.019166 (+ 1382us) server_negotiation.cc:407] Connection header received
0811 12:39:45.021433 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:45.021439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:45.021541 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:45.021672 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:45.023659 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.025181 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.027895 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.028535 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.028684 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.034364 (+ 5680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:45.034372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:45.034377 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:45.034429 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:45.037887 (+ 3458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.039031 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.039039 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.039044 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.039221 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.039850 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.039859 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.039866 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.040382 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:45.040617 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:45.041832 (+ 1215us) server_negotiation.cc:299] Negotiation successful
0811 12:39:45.042208 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":323,"threads_started":1}
I20260811 12:39:45.043306 2152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.018002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.186.65:48267)
0811 12:39:45.018972 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:45.019044 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:45.021140 (+ 2096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:45.021925 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:45.021933 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:45.022494 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:45.023361 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.023382 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.025405 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.025413 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.027711 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.027727 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.028870 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.028880 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.029167 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.030028 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:45.030054 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:45.034030 (+ 3976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:45.038100 (+ 4070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.038112 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.038137 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.038777 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.039340 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.039345 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.039352 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.039681 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.040758 (+ 1077us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:45.040770 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:45.041290 (+ 520us) client_negotiation.cc:769] Sending connection context
0811 12:39:45.041629 (+ 339us) client_negotiation.cc:240] Negotiation successful
0811 12:39:45.042055 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":371,"threads_started":1}
I20260811 12:39:45.065917 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.051304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:42071 (local address 127.0.186.126:34101)
0811 12:39:45.051508 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:45.051514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:45.052452 (+ 938us) server_negotiation.cc:407] Connection header received
0811 12:39:45.052674 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:45.052678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:45.052791 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:45.052913 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:45.054289 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.055341 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.057452 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.058101 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.058243 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.060155 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:45.060160 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:45.060163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:45.060194 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:45.063058 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.063756 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.063762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.063765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.063908 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.064302 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.064309 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.064312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.064615 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:45.064795 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:45.065296 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 12:39:45.065539 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:39:45.066021 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.051383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.186.65:42071)
0811 12:39:45.052289 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:45.052325 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:45.052534 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:45.052951 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:45.052955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:45.053599 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:45.054137 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.054149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.055494 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.055498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.057239 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.057260 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.058315 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.058323 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.058477 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.059157 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:45.059175 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:45.059941 (+ 766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:45.063191 (+ 3250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.063197 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.063201 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.063627 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.064022 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.064047 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.064050 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.064183 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.064760 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:45.064765 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:45.065014 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 12:39:45.065191 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 12:39:45.065542 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":466,"threads_started":1}
I20260811 12:39:45.079494 2124 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:43479
I20260811 12:39:45.079521 2277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:43479 every 8 connection(s)
I20260811 12:39:45.080971 2124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:39:45.082629 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 2124
I20260811 12:39:45.082906 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:39:45.083314 2278 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34101
I20260811 12:39:45.083508 2278 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:45.083699 745 external_mini_cluster.cc:1428] Setting key fb6e643f96f002326d10fe2b7d49845d
I20260811 12:39:45.084159 2278 heartbeater.cc:511] Master 127.0.186.126:34101 requested a full tablet report, sending...
I20260811 12:39:45.086526 2047 ts_manager.cc:194] Registered new tserver with Master: ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65:43479)
I20260811 12:39:45.088770 2047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:48267
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:39:45.138008 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34101
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:45.491493 2282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:45.491842 2282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:45.492033 2282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:45.499897 2282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:45.500084 2282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:45.500252 2282 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:39:45.500396 2282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:39:45.510550 2282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:34101
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:45.512022 2282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:45.513480 2282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:45.528101 2288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:45.528132 2289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:45.528156 2291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:45.534895 2282 server_base.cc:1034] running on GCE node
I20260811 12:39:45.535734 2282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:45.536863 2282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:45.538162 2282 hybrid_clock.cc:648] HybridClock initialized: now 1786451985538096 us; error 32 us; skew 500 ppm
I20260811 12:39:45.538537 2282 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:45 dist-test-slave-qg60 krb5kdc[1993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451985, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:45.542281 2282 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:39:45.544080 2282 webserver.cc:460] Webserver started at http://127.0.186.66:45179/ using document root <none> and password file <none>
I20260811 12:39:45.544958 2282 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:45.545055 2282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:45.545349 2282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:45.548552 2282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "05b4201ab85c428d85a76958c4cabb37"
format_stamp: "Formatted at 2026-08-11 12:39:45 on dist-test-slave-qg60"
server_key: "ef79c0dfe99ccf144fed414f981b2b8f"
server_key_iv: "8b71ea30d79dd387308d54bc8e66e094"
server_key_version: "encryptionkey@0"
I20260811 12:39:45.549429 2282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "05b4201ab85c428d85a76958c4cabb37"
format_stamp: "Formatted at 2026-08-11 12:39:45 on dist-test-slave-qg60"
server_key: "ef79c0dfe99ccf144fed414f981b2b8f"
server_key_iv: "8b71ea30d79dd387308d54bc8e66e094"
server_key_version: "encryptionkey@0"
I20260811 12:39:45.554991 2282 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 12:39:45.558882 2299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:45.560663 2282 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:45.560933 2282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "05b4201ab85c428d85a76958c4cabb37"
format_stamp: "Formatted at 2026-08-11 12:39:45 on dist-test-slave-qg60"
server_key: "ef79c0dfe99ccf144fed414f981b2b8f"
server_key_iv: "8b71ea30d79dd387308d54bc8e66e094"
server_key_version: "encryptionkey@0"
I20260811 12:39:45.561259 2282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:45.582686 2282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:45.587302 2282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:45.587571 2282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:45.590662 2282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:45.590806 2282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:45.591058 2282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:45.591215 2282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:39:45 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451985, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:45.618392 2309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.590917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:36063 (local address 127.0.186.126:34101)
0811 12:39:45.591519 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:45.591529 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:45.592803 (+ 1274us) server_negotiation.cc:407] Connection header received
0811 12:39:45.595001 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:45.595007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:45.595102 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:45.595233 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:45.597760 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.599163 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.601719 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.602622 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.602800 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.609256 (+ 6456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:45.609266 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:45.609273 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:45.609338 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:45.613768 (+ 4430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.614609 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.614617 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.614623 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.614802 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.615468 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.615475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.615482 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.615917 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:45.616083 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:45.617435 (+ 1352us) server_negotiation.cc:299] Negotiation successful
0811 12:39:45.617788 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":293,"threads_started":1}
I20260811 12:39:45.618973 2312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.591615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.186.66:36063)
0811 12:39:45.592615 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:45.592661 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:45.594655 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:45.595500 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:45.595508 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:45.596434 (+ 926us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:45.597428 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.597448 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.599431 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.599438 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.601536 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.601551 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.603163 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.603171 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.603617 (+ 446us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.604625 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:45.604669 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:45.608856 (+ 4187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:45.613942 (+ 5086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.613950 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.613964 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.614464 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.614943 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.614951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.614957 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.615329 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.616151 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:45.616160 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:45.616826 (+ 666us) client_negotiation.cc:769] Sending connection context
0811 12:39:45.617261 (+ 435us) client_negotiation.cc:240] Negotiation successful
0811 12:39:45.617696 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":404,"threads_started":1}
I20260811 12:39:45.641839 2309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.624995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:52935 (local address 127.0.186.126:34101)
0811 12:39:45.625209 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:45.625215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:45.626071 (+ 856us) server_negotiation.cc:407] Connection header received
0811 12:39:45.626272 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:45.626275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:45.626342 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:45.626423 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:45.627938 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.628670 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.631281 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.632051 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.632198 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.635274 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:45.635279 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:45.635282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:45.635316 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:45.638699 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.639663 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.639670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.639673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.639811 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:45.640193 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:45.640198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:45.640202 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:45.640550 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:45.640713 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:45.641215 (+ 502us) server_negotiation.cc:299] Negotiation successful
0811 12:39:45.641458 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 12:39:45.642177 2386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:45.625126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.186.66:52935)
0811 12:39:45.625930 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:45.625957 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:45.626143 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:45.626495 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:45.626502 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:45.627273 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:45.627764 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.627780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.628860 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.628869 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.631092 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:45.631112 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:45.632510 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:45.632521 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:45.632866 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:45.633608 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:45.633639 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:45.635025 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:45.638829 (+ 3804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.638834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.638839 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.639517 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.639929 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:45.639934 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:45.639938 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:45.640080 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:45.640674 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:45.640679 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:45.640915 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 12:39:45.641121 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 12:39:45.641507 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":409,"threads_started":1}
I20260811 12:39:45.648123 2282 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:43885
I20260811 12:39:45.648161 2438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:43885 every 8 connection(s)
I20260811 12:39:45.649554 2282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:39:45.651767 2439 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34101
I20260811 12:39:45.652127 2439 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:45.652347 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 2282
I20260811 12:39:45.652580 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:39:45.653057 2439 heartbeater.cc:511] Master 127.0.186.126:34101 requested a full tablet report, sending...
I20260811 12:39:45.653203 745 external_mini_cluster.cc:1428] Setting key c553eaf5c3b6e53e65c76b65b23101a5
I20260811 12:39:45.654706 2047 ts_manager.cc:194] Registered new tserver with Master: 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885)
I20260811 12:39:45.655893 2047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:36063
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:39:45.708566 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34101
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:46.070607 2443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:46.070905 2443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:46.071100 2443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:46.079092 2443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:46.079252 2443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:46.079412 2443 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:39:46.079563 2443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:39:46.089804 2443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:34101
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:46.091120 2443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:46.092406 2278 heartbeater.cc:503] Master 127.0.186.126:34101 was elected leader, sending a full tablet report...
I20260811 12:39:46.092578 2443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:46.107535 2448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:46.107494 2451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:46.107430 2449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:46.108492 2443 server_base.cc:1034] running on GCE node
I20260811 12:39:46.109258 2443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:46.110342 2443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:46.111627 2443 hybrid_clock.cc:648] HybridClock initialized: now 1786451986111562 us; error 40 us; skew 500 ppm
I20260811 12:39:46.111979 2443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:46 dist-test-slave-qg60 krb5kdc[1993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:46.115530 2443 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:39:46.117340 2443 webserver.cc:460] Webserver started at http://127.0.186.67:39401/ using document root <none> and password file <none>
I20260811 12:39:46.118124 2443 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:46.118268 2443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:46.118638 2443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:46.122092 2443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "25acdda1c6174413b152893f0f8e4605"
format_stamp: "Formatted at 2026-08-11 12:39:46 on dist-test-slave-qg60"
server_key: "fc0c24c4952c285f508ed2b50ca0cbfc"
server_key_iv: "5e8791be6914f89e450cdc078637f931"
server_key_version: "encryptionkey@0"
I20260811 12:39:46.122958 2443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "25acdda1c6174413b152893f0f8e4605"
format_stamp: "Formatted at 2026-08-11 12:39:46 on dist-test-slave-qg60"
server_key: "fc0c24c4952c285f508ed2b50ca0cbfc"
server_key_iv: "5e8791be6914f89e450cdc078637f931"
server_key_version: "encryptionkey@0"
I20260811 12:39:46.128618 2443 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 12:39:46.132396 2460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:46.134043 2443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:39:46.134232 2443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "25acdda1c6174413b152893f0f8e4605"
format_stamp: "Formatted at 2026-08-11 12:39:46 on dist-test-slave-qg60"
server_key: "fc0c24c4952c285f508ed2b50ca0cbfc"
server_key_iv: "5e8791be6914f89e450cdc078637f931"
server_key_version: "encryptionkey@0"
I20260811 12:39:46.134488 2443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:46.148614 2443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:46.153594 2443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:46.153896 2443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:46.156692 2443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:46.156879 2443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:39:46.157088 2443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:46.157232 2443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:39:46 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:46.183429 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.157308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:39663 (local address 127.0.186.126:34101)
0811 12:39:46.157819 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.157827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.159196 (+ 1369us) server_negotiation.cc:407] Connection header received
0811 12:39:46.161796 (+ 2600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.161802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.161899 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.162039 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:46.164526 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.166000 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.168992 (+ 2992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.169850 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.170044 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.175071 (+ 5027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:46.175082 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:46.175089 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:46.175159 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:46.178575 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:46.180311 (+ 1736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:46.180317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:46.180319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:46.180489 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:46.181300 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:46.181307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:46.181311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:46.181689 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:46.181866 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.182726 (+ 860us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.182980 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":249,"threads_started":1}
I20260811 12:39:46.184852 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.157976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.186.67:39663)
0811 12:39:46.158969 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.159042 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.161426 (+ 2384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.162396 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.162412 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.163346 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:46.164271 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.164296 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.166223 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.166231 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.168771 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.168796 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.170136 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.170142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.170346 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.171218 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:46.171243 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:46.174727 (+ 3484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:46.178752 (+ 4025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:46.178766 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:46.178792 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:46.180127 (+ 1335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:46.180635 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:46.180644 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:46.180651 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:46.181126 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:46.181842 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:46.181851 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:46.182309 (+ 458us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.182601 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.183202 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":449,"threads_started":1}
I20260811 12:39:46.211475 2545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.193507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.186.67:55765)
0811 12:39:46.194321 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.194343 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.194527 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.194908 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.194913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.195476 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:46.195785 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.195795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.197014 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.197022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.198749 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.198774 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.200505 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.200516 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.200906 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.201861 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:46.201898 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:46.203731 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:46.207712 (+ 3981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:46.207718 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:46.207722 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:46.208495 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:46.209136 (+ 641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:46.209143 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:46.209148 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:46.209359 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:46.210219 (+ 860us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:46.210226 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:46.210561 (+ 335us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.210763 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.211113 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":511,"threads_started":1}
I20260811 12:39:46.211880 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.193440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:55765 (local address 127.0.186.126:34101)
0811 12:39:46.193665 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.193673 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.194452 (+ 779us) server_negotiation.cc:407] Connection header received
0811 12:39:46.194676 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.194684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.194770 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.194879 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:46.195942 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.196855 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.198986 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.199960 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.200140 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.204009 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:46.204015 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:46.204018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:46.204056 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:46.207544 (+ 3488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:46.208754 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:46.208764 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:46.208770 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:46.208975 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:46.209509 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:46.209517 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:46.209520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:46.209971 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:46.210141 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.210943 (+ 802us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.211307 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 12:39:46.224581 2443 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:33261
I20260811 12:39:46.224619 2598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:33261 every 8 connection(s)
I20260811 12:39:46.225997 2443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:39:46.228266 2601 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34101
I20260811 12:39:46.228487 2601 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:46.229269 2601 heartbeater.cc:511] Master 127.0.186.126:34101 requested a full tablet report, sending...
I20260811 12:39:46.230670 2047 ts_manager.cc:194] Registered new tserver with Master: 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261)
I20260811 12:39:46.231542 2047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:39663
I20260811 12:39:46.233361 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 2443
I20260811 12:39:46.233589 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:39:46.234207 745 external_mini_cluster.cc:1428] Setting key d6260eeebf0602757aa4f89f268ae1d6
I20260811 12:39:46.238070 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 12:39:46 dist-test-slave-qg60 krb5kdc[1993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 12:39:46 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:46.295020 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.280220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51684 (local address 127.0.186.126:34101)
0811 12:39:46.280465 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.280472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.280645 (+ 173us) server_negotiation.cc:407] Connection header received
0811 12:39:46.280877 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.280881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.280952 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.281043 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:46.282585 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.283317 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.284724 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.285240 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.285341 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.289515 (+ 4174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:46.289520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:46.289523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:46.289560 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:46.292007 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:46.292712 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:46.292720 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:46.292723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:46.292949 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:46.293361 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:46.293368 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:46.293371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:46.293675 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:46.293966 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.294269 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.294522 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 12:39:46.300091 2047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:46.307739 2047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:46.336336 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.321207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56392 (local address 127.0.186.66:43885)
0811 12:39:46.321867 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.321878 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.321967 (+ 89us) server_negotiation.cc:407] Connection header received
0811 12:39:46.322707 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.322721 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.323025 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.326945 (+ 3920us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:46.327644 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.329550 (+ 1906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.332821 (+ 3271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.334636 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.334776 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.335516 (+ 740us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.335827 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.336007 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":301,"threads_started":1}
I20260811 12:39:46.336392 2619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.322071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33261 (local address 127.0.0.1:35136)
0811 12:39:46.322721 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.322739 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.322843 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.325164 (+ 2321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.325170 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.325229 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:46.326391 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.326405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.330077 (+ 3672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.330083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.332400 (+ 2317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.332413 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.335457 (+ 3044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.335464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.335665 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.335711 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.335780 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.336027 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":612,"thread_start_us":355,"threads_started":1}
I20260811 12:39:46.336784 2620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.322815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35136 (local address 127.0.186.67:33261)
0811 12:39:46.324195 (+ 1380us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.324208 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.324249 (+ 41us) server_negotiation.cc:407] Connection header received
0811 12:39:46.324366 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.324378 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.324855 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.325570 (+ 715us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:46.326750 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.328815 (+ 2065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.332582 (+ 3767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.335192 (+ 2610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.335940 (+ 748us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.336173 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.336240 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.336398 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1146,"thread_start_us":946,"threads_started":1}
I20260811 12:39:46.337345 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.320968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:43885 (local address 127.0.0.1:56392)
0811 12:39:46.321840 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.321885 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.322087 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.324973 (+ 2886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.324984 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.325023 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:46.327384 (+ 2361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.327414 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.329678 (+ 2264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.329686 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.332607 (+ 2921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.332627 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.335014 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.335022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.335542 (+ 520us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.335619 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.335777 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.336991 (+ 1214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":175,"thread_start_us":376,"threads_started":1}
I20260811 12:39:46.339390 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.323645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45782 (local address 127.0.186.65:43479)
0811 12:39:46.324964 (+ 1319us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.324972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.325416 (+ 444us) server_negotiation.cc:407] Connection header received
0811 12:39:46.325725 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.325733 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.325964 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.326174 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:46.327868 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.329536 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.335637 (+ 6101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.337165 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.337331 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.337539 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.338891 (+ 1352us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.339096 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1147,"thread_start_us":973,"threads_started":1}
I20260811 12:39:46.339727 2621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.323446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43479 (local address 127.0.0.1:45782)
0811 12:39:46.325228 (+ 1782us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.325247 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.325522 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.326432 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.326439 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.326472 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:46.327669 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.327683 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.333006 (+ 5323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.333014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.335484 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.335501 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.337425 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.337433 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.337623 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.337656 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.338364 (+ 708us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.338507 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":58,"thread_start_us":776,"threads_started":1}
I20260811 12:39:46.341110 2522 tablet_service.cc:1467] Processing CreateTablet for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb (DEFAULT_TABLE table=test-table [id=62a874567aa84b7c9e9140554609e0be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:46.341149 2361 tablet_service.cc:1467] Processing CreateTablet for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb (DEFAULT_TABLE table=test-table [id=62a874567aa84b7c9e9140554609e0be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:46.342455 2522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:46.342578 2361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:46.343431 2201 tablet_service.cc:1467] Processing CreateTablet for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb (DEFAULT_TABLE table=test-table [id=62a874567aa84b7c9e9140554609e0be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:46.345006 2201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:46.355257 2625 tablet_bootstrap.cc:492] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Bootstrap starting.
I20260811 12:39:46.357970 2626 tablet_bootstrap.cc:492] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Bootstrap starting.
I20260811 12:39:46.359422 2625 tablet_bootstrap.cc:654] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:46.360339 2628 tablet_bootstrap.cc:492] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Bootstrap starting.
I20260811 12:39:46.361944 2626 tablet_bootstrap.cc:654] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:46.362509 2625 log.cc:824] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:46.363384 2626 log.cc:824] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:46.364114 2628 tablet_bootstrap.cc:654] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:46.365303 2628 log.cc:824] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:46.366019 2625 tablet_bootstrap.cc:492] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: No bootstrap required, opened a new log
I20260811 12:39:46.366325 2625 ts_tablet_manager.cc:1397] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 12:39:46.367609 2626 tablet_bootstrap.cc:492] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: No bootstrap required, opened a new log
I20260811 12:39:46.367936 2626 ts_tablet_manager.cc:1397] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 12:39:46.368633 2628 tablet_bootstrap.cc:492] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: No bootstrap required, opened a new log
I20260811 12:39:46.369017 2628 ts_tablet_manager.cc:1397] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260811 12:39:46.376796 2628 raft_consensus.cc:348] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.377360 2628 raft_consensus.cc:374] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:46.377514 2628 raft_consensus.cc:729] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4bd099117145a9871fb5dab2590fe6, State: Initialized, Role: FOLLOWER
I20260811 12:39:46.378240 2628 consensus_queue.cc:260] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.378515 2625 raft_consensus.cc:348] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.379056 2625 raft_consensus.cc:374] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:46.379215 2625 raft_consensus.cc:729] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25acdda1c6174413b152893f0f8e4605, State: Initialized, Role: FOLLOWER
I20260811 12:39:46.379140 2626 raft_consensus.cc:348] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.379608 2626 raft_consensus.cc:374] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:46.379750 2626 raft_consensus.cc:729] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b4201ab85c428d85a76958c4cabb37, State: Initialized, Role: FOLLOWER
I20260811 12:39:46.380153 2628 ts_tablet_manager.cc:1428] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260811 12:39:46.380211 2625 consensus_queue.cc:260] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.380455 2626 consensus_queue.cc:260] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.381613 2439 heartbeater.cc:503] Master 127.0.186.126:34101 was elected leader, sending a full tablet report...
I20260811 12:39:46.382436 2626 ts_tablet_manager.cc:1428] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260811 12:39:46.389506 2601 heartbeater.cc:503] Master 127.0.186.126:34101 was elected leader, sending a full tablet report...
I20260811 12:39:46.390372 2625 ts_tablet_manager.cc:1428] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Time spent starting tablet: real 0.024s user 0.010s sys 0.011s
W20260811 12:39:46.401865 2440 tablet.cc:2369] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:39:46.477926 2602 tablet.cc:2369] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:46.526011 2633 raft_consensus.cc:482] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:46.526396 2633 raft_consensus.cc:504] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.528244 2633 leader_election.cc:288] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885), 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261)
I20260811 12:39:46.538820 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.528716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:52879 (local address 127.0.186.66:43885)
0811 12:39:46.528992 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.528999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.529971 (+ 972us) server_negotiation.cc:407] Connection header received
0811 12:39:46.530170 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.530175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.530260 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.530364 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:46.531336 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.532520 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.536039 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.537535 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.537736 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.537820 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.538365 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.538564 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 12:39:46.538820 2620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.528907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:36227 (local address 127.0.186.67:33261)
0811 12:39:46.529149 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.529155 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.529977 (+ 822us) server_negotiation.cc:407] Connection header received
0811 12:39:46.530170 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.530176 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.530260 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.530364 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:46.531336 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.532566 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.536071 (+ 3505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.537535 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.537736 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.537820 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.538383 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.538525 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:39:46.539034 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.528763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33261 (local address 127.0.186.65:36227)
0811 12:39:46.529841 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.529857 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.530020 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.530399 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.530405 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.530440 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:46.531104 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.531146 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.532768 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.532774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.535817 (+ 3043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.535826 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.537860 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.537869 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.538117 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.538176 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.538287 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.538494 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":956,"mutex_wait_us":281,"spinlock_wait_cycles":51968,"thread_start_us":660,"threads_started":1}
I20260811 12:39:46.539095 2636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.528587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:43885 (local address 127.0.186.65:52879)
0811 12:39:46.529815 (+ 1228us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:46.529841 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:46.530012 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:46.530399 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:46.530405 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:46.530446 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:46.531129 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.531139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.532770 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.532774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.535809 (+ 3035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:46.535826 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.537964 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.537973 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:46.538170 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.538201 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 12:39:46.538287 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 12:39:46.538486 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":416,"spinlock_wait_cycles":52608,"thread_start_us":628,"threads_started":1}
I20260811 12:39:46.540318 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ee5bc5c3c142e2ae040c3a6e4f56cb" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b4201ab85c428d85a76958c4cabb37" is_pre_election: true
I20260811 12:39:46.540309 2550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ee5bc5c3c142e2ae040c3a6e4f56cb" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25acdda1c6174413b152893f0f8e4605" is_pre_election: true
I20260811 12:39:46.540903 2390 raft_consensus.cc:2454] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 0.
I20260811 12:39:46.540902 2550 raft_consensus.cc:2454] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 0.
I20260811 12:39:46.541673 2142 leader_election.cc:302] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 05b4201ab85c428d85a76958c4cabb37, 25acdda1c6174413b152893f0f8e4605, ec4bd099117145a9871fb5dab2590fe6; no voters:
I20260811 12:39:46.542145 2633 raft_consensus.cc:2781] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:46.542305 2633 raft_consensus.cc:482] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:46.542436 2633 raft_consensus.cc:3037] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:46.545207 2633 raft_consensus.cc:504] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.545986 2633 leader_election.cc:288] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 election: Requested vote from peers 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885), 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261)
I20260811 12:39:46.546566 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ee5bc5c3c142e2ae040c3a6e4f56cb" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b4201ab85c428d85a76958c4cabb37"
I20260811 12:39:46.546567 2550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ee5bc5c3c142e2ae040c3a6e4f56cb" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25acdda1c6174413b152893f0f8e4605"
I20260811 12:39:46.546808 2550 raft_consensus.cc:3037] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:46.546808 2390 raft_consensus.cc:3037] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:46.550338 2390 raft_consensus.cc:2454] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 1.
I20260811 12:39:46.550338 2550 raft_consensus.cc:2454] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 1.
I20260811 12:39:46.550992 2144 leader_election.cc:302] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25acdda1c6174413b152893f0f8e4605, ec4bd099117145a9871fb5dab2590fe6; no voters:
I20260811 12:39:46.551337 2633 raft_consensus.cc:2781] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:46.552026 2633 raft_consensus.cc:686] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 1 LEADER]: Becoming Leader. State: Replica: ec4bd099117145a9871fb5dab2590fe6, State: Running, Role: LEADER
I20260811 12:39:46.552718 2633 consensus_queue.cc:237] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } }
I20260811 12:39:46.557989 2045 catalog_manager.cc:5495] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65). New cstate: current_term: 1 leader_uuid: "ec4bd099117145a9871fb5dab2590fe6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } health_report { overall_health: HEALTHY } } }
W20260811 12:39:46.583947 2279 tablet.cc:2369] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:46.639042 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:46.633204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45786 (local address 127.0.186.65:43479)
0811 12:39:46.633422 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:46.633426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:46.633446 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:39:46.633712 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:46.633716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:46.633813 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:46.633944 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:46.634578 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.635330 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.636777 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:46.637201 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:46.637307 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:46.637827 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:46.638472 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:46.638634 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:46.638741 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 12:39:46.638818 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:39:46.647882 2390 raft_consensus.cc:1261] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Refusing update from remote peer ec4bd099117145a9871fb5dab2590fe6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:46.647871 2550 raft_consensus.cc:1261] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Refusing update from remote peer ec4bd099117145a9871fb5dab2590fe6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:46.649096 2638 consensus_queue.cc:1035] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:46.649631 2633 consensus_queue.cc:1035] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:46.666141 2641 mvcc.cc:205] Tried to move back new op lower bound from 7317307337298534400 to 7317307336924282880. Current Snapshot: MvccSnapshot[applied={T|T < 7317307337298534400}]
I20260811 12:39:46.691291 2046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:46.691782 2046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:46.696588 2046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: Sending DeleteTablet for 3 replicas of tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb
I20260811 12:39:46.698030 2361 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:46 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:56392
I20260811 12:39:46.698009 2522 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:46 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:35136
I20260811 12:39:46.698015 2201 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:46 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:45782
I20260811 12:39:46.701906 2045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:46.702847 2045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:46.709228 2652 tablet_replica.cc:330] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: stopping tablet replica
I20260811 12:39:46.709842 2652 raft_consensus.cc:2229] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:39:46.710702 2652 raft_consensus.cc:2258] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:46.711385 2651 tablet_replica.cc:330] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: stopping tablet replica
I20260811 12:39:46.711869 2651 raft_consensus.cc:2229] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:46.712391 2651 raft_consensus.cc:2258] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:46.713367 2650 tablet_replica.cc:330] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: stopping tablet replica
I20260811 12:39:46.713302 2522 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3186b577044c1db27a875e290a14f6 (DEFAULT_TABLE table=test-table [id=bdef74b1e21a4cc48ba96976307e8b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:46.713498 2360 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3186b577044c1db27a875e290a14f6 (DEFAULT_TABLE table=test-table [id=bdef74b1e21a4cc48ba96976307e8b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:46.713868 2650 raft_consensus.cc:2229] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:46.713994 2522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d3186b577044c1db27a875e290a14f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:46.714138 2360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d3186b577044c1db27a875e290a14f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:46.714445 2650 raft_consensus.cc:2258] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:46.717522 2201 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3186b577044c1db27a875e290a14f6 (DEFAULT_TABLE table=test-table [id=bdef74b1e21a4cc48ba96976307e8b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:46.718029 2201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d3186b577044c1db27a875e290a14f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:46.719509 2651 ts_tablet_manager.cc:1905] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:46.722774 2650 ts_tablet_manager.cc:1905] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:46.724699 2626 tablet_bootstrap.cc:492] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Bootstrap starting.
I20260811 12:39:46.726704 2626 tablet_bootstrap.cc:654] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:46.729055 2652 ts_tablet_manager.cc:1905] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:46.730312 2628 tablet_bootstrap.cc:492] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Bootstrap starting.
I20260811 12:39:46.732204 2628 tablet_bootstrap.cc:654] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:46.746917 2625 tablet_bootstrap.cc:492] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Bootstrap starting.
I20260811 12:39:46.750087 2625 tablet_bootstrap.cc:654] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:46.755323 2625 tablet_bootstrap.cc:492] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: No bootstrap required, opened a new log
I20260811 12:39:46.755508 2625 ts_tablet_manager.cc:1397] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260811 12:39:46.756397 2625 raft_consensus.cc:348] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:46.756665 2625 raft_consensus.cc:374] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:46.756826 2625 raft_consensus.cc:729] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25acdda1c6174413b152893f0f8e4605, State: Initialized, Role: FOLLOWER
I20260811 12:39:46.757189 2625 consensus_queue.cc:260] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:46.759085 2651 ts_tablet_manager.cc:1918] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:39:46.759332 2651 log.cc:1196] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/e2ee5bc5c3c142e2ae040c3a6e4f56cb
I20260811 12:39:46.759609 2650 ts_tablet_manager.cc:1918] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:39:46.759840 2650 log.cc:1196] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/e2ee5bc5c3c142e2ae040c3a6e4f56cb
I20260811 12:39:46.760223 2651 ts_tablet_manager.cc:1939] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 25acdda1c6174413b152893f0f8e4605: Deleting consensus metadata
I20260811 12:39:46.760560 2625 ts_tablet_manager.cc:1428] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260811 12:39:46.762607 2628 tablet_bootstrap.cc:492] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: No bootstrap required, opened a new log
I20260811 12:39:46.762804 2628 ts_tablet_manager.cc:1397] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.008s
I20260811 12:39:46.763302 2030 catalog_manager.cc:4841] TS 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261): tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb (table test-table [id=62a874567aa84b7c9e9140554609e0be]) successfully deleted
I20260811 12:39:46.763926 2628 raft_consensus.cc:348] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:46.764199 2628 raft_consensus.cc:374] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:46.764318 2628 raft_consensus.cc:729] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4bd099117145a9871fb5dab2590fe6, State: Initialized, Role: FOLLOWER
I20260811 12:39:46.764684 2628 consensus_queue.cc:260] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:46.766146 2628 ts_tablet_manager.cc:1428] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 12:39:46.760448 2650 ts_tablet_manager.cc:1939] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P 05b4201ab85c428d85a76958c4cabb37: Deleting consensus metadata
I20260811 12:39:46.761790 2626 tablet_bootstrap.cc:492] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: No bootstrap required, opened a new log
I20260811 12:39:46.766551 2626 ts_tablet_manager.cc:1397] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.012s
I20260811 12:39:46.767525 2626 raft_consensus.cc:348] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:46.767794 2626 raft_consensus.cc:374] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:46.767911 2626 raft_consensus.cc:729] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b4201ab85c428d85a76958c4cabb37, State: Initialized, Role: FOLLOWER
I20260811 12:39:46.768155 2626 consensus_queue.cc:260] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:46.768781 2626 ts_tablet_manager.cc:1428] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 12:39:46.768766 2652 ts_tablet_manager.cc:1918] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:39:46.769021 2652 log.cc:1196] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/e2ee5bc5c3c142e2ae040c3a6e4f56cb
I20260811 12:39:46.769781 2652 ts_tablet_manager.cc:1939] T e2ee5bc5c3c142e2ae040c3a6e4f56cb P ec4bd099117145a9871fb5dab2590fe6: Deleting consensus metadata
I20260811 12:39:46.771677 2031 catalog_manager.cc:4841] TS ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65:43479): tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb (table test-table [id=62a874567aa84b7c9e9140554609e0be]) successfully deleted
I20260811 12:39:46.771785 2028 catalog_manager.cc:4841] TS 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885): tablet e2ee5bc5c3c142e2ae040c3a6e4f56cb (table test-table [id=62a874567aa84b7c9e9140554609e0be]) successfully deleted
I20260811 12:39:47.044232 2638 raft_consensus.cc:482] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:47.044510 2638 raft_consensus.cc:504] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.045288 2638 leader_election.cc:288] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885), 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261)
I20260811 12:39:47.046034 2550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d3186b577044c1db27a875e290a14f6" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25acdda1c6174413b152893f0f8e4605" is_pre_election: true
I20260811 12:39:47.046073 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d3186b577044c1db27a875e290a14f6" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b4201ab85c428d85a76958c4cabb37" is_pre_election: true
I20260811 12:39:47.046353 2550 raft_consensus.cc:2454] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 0.
I20260811 12:39:47.046401 2390 raft_consensus.cc:2454] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 0.
I20260811 12:39:47.046958 2144 leader_election.cc:302] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25acdda1c6174413b152893f0f8e4605, ec4bd099117145a9871fb5dab2590fe6; no voters:
I20260811 12:39:47.047349 2638 raft_consensus.cc:2781] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:47.047487 2638 raft_consensus.cc:482] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:47.047632 2638 raft_consensus.cc:3037] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:47.050107 2638 raft_consensus.cc:504] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.050861 2638 leader_election.cc:288] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 election: Requested vote from peers 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885), 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261)
I20260811 12:39:47.051472 2550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d3186b577044c1db27a875e290a14f6" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25acdda1c6174413b152893f0f8e4605"
I20260811 12:39:47.051496 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d3186b577044c1db27a875e290a14f6" candidate_uuid: "ec4bd099117145a9871fb5dab2590fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b4201ab85c428d85a76958c4cabb37"
I20260811 12:39:47.051736 2550 raft_consensus.cc:3037] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:47.051774 2390 raft_consensus.cc:3037] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:47.054136 2550 raft_consensus.cc:2454] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 1.
I20260811 12:39:47.054704 2144 leader_election.cc:302] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25acdda1c6174413b152893f0f8e4605, ec4bd099117145a9871fb5dab2590fe6; no voters:
I20260811 12:39:47.055073 2638 raft_consensus.cc:2781] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:47.055289 2638 raft_consensus.cc:686] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 1 LEADER]: Becoming Leader. State: Replica: ec4bd099117145a9871fb5dab2590fe6, State: Running, Role: LEADER
I20260811 12:39:47.055318 2390 raft_consensus.cc:2454] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4bd099117145a9871fb5dab2590fe6 in term 1.
I20260811 12:39:47.055589 2638 consensus_queue.cc:237] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.059001 2045 catalog_manager.cc:5495] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65). New cstate: current_term: 1 leader_uuid: "ec4bd099117145a9871fb5dab2590fe6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } health_report { overall_health: UNKNOWN } } }
Aug 11 12:39:47 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:47.145916 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.127507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34101 (local address 127.0.0.1:51692)
0811 12:39:47.129378 (+ 1871us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:47.129404 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:47.129608 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:47.130105 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:47.130111 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:47.131119 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:47.131417 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.131433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.132624 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.132630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.134290 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.134312 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.135250 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.135258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.135461 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.136307 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:47.136335 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:47.139662 (+ 3327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:47.142988 (+ 3326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:47.143002 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:47.143010 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:47.143462 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:47.143846 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:47.143853 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:47.143856 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:47.144005 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:47.144564 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:47.144572 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:47.144832 (+ 260us) client_negotiation.cc:769] Sending connection context
0811 12:39:47.145010 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 12:39:47.145386 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1662,"thread_start_us":1470,"threads_started":1}
I20260811 12:39:47.145943 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.127507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51692 (local address 127.0.186.126:34101)
0811 12:39:47.129767 (+ 2260us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.129771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.129795 (+ 24us) server_negotiation.cc:407] Connection header received
0811 12:39:47.129843 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.129846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.129908 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.130008 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:47.131655 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.132461 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.134505 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.134992 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.135103 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.139884 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:47.139889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:47.139892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:47.139925 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:47.142829 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.143602 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.143612 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.143614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.143734 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.144122 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.144137 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.144145 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.144425 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:47.144589 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.145134 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.145547 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":175,"server-negotiator.queue_time_us":2152,"thread_start_us":1995,"threads_started":1}
I20260811 12:39:47.153270 2045 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:51692:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 12:39:47.154706 2045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:47.163718 2522 tablet_service.cc:1467] Processing CreateTablet for tablet 9e654f8121454fa987c5991386e8db2d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6ad71f640b674e15990db0f6d143be5d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:39:47.163877 2201 tablet_service.cc:1467] Processing CreateTablet for tablet 9e654f8121454fa987c5991386e8db2d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6ad71f640b674e15990db0f6d143be5d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:39:47.164157 2360 tablet_service.cc:1467] Processing CreateTablet for tablet 9e654f8121454fa987c5991386e8db2d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6ad71f640b674e15990db0f6d143be5d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:39:47.164439 2522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e654f8121454fa987c5991386e8db2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:47.164486 2201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e654f8121454fa987c5991386e8db2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:47.164649 2360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e654f8121454fa987c5991386e8db2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:47.173990 2625 tablet_bootstrap.cc:492] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: Bootstrap starting.
I20260811 12:39:47.173995 2628 tablet_bootstrap.cc:492] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: Bootstrap starting.
I20260811 12:39:47.175714 2626 tablet_bootstrap.cc:492] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: Bootstrap starting.
I20260811 12:39:47.176066 2625 tablet_bootstrap.cc:654] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:47.176143 2628 tablet_bootstrap.cc:654] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:47.177647 2626 tablet_bootstrap.cc:654] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:47.188676 2625 tablet_bootstrap.cc:492] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: No bootstrap required, opened a new log
I20260811 12:39:47.188989 2628 tablet_bootstrap.cc:492] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: No bootstrap required, opened a new log
I20260811 12:39:47.189136 2625 ts_tablet_manager.cc:1397] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.005s
I20260811 12:39:47.189194 2628 ts_tablet_manager.cc:1397] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260811 12:39:47.189248 2626 tablet_bootstrap.cc:492] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: No bootstrap required, opened a new log
I20260811 12:39:47.189440 2626 ts_tablet_manager.cc:1397] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.006s
I20260811 12:39:47.190109 2625 raft_consensus.cc:348] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.190109 2628 raft_consensus.cc:348] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.190403 2628 raft_consensus.cc:374] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:47.190268 2626 raft_consensus.cc:348] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.190502 2628 raft_consensus.cc:729] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4bd099117145a9871fb5dab2590fe6, State: Initialized, Role: FOLLOWER
I20260811 12:39:47.190527 2626 raft_consensus.cc:374] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:47.190594 2626 raft_consensus.cc:729] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b4201ab85c428d85a76958c4cabb37, State: Initialized, Role: FOLLOWER
I20260811 12:39:47.190563 2625 raft_consensus.cc:374] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:47.190794 2625 raft_consensus.cc:729] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25acdda1c6174413b152893f0f8e4605, State: Initialized, Role: FOLLOWER
I20260811 12:39:47.190855 2628 consensus_queue.cc:260] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.191229 2625 consensus_queue.cc:260] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.191450 2638 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.191798 2638 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.191804 2634 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.192108 2634 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.192106 2626 consensus_queue.cc:260] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.192812 2626 ts_tablet_manager.cc:1428] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 12:39:47.192973 2635 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.193312 2635 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.193379 2628 ts_tablet_manager.cc:1428] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 12:39:47.194507 2625 ts_tablet_manager.cc:1428] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 12:39:47.445673 2638 consensus_queue.cc:1035] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:47.451332 2638 consensus_queue.cc:1035] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:47.484108 2634 raft_consensus.cc:482] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:47.484362 2634 raft_consensus.cc:504] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.486104 2634 leader_election.cc:288] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65:43479), 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885)
I20260811 12:39:47.504153 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.486652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:52343 (local address 127.0.186.65:43479)
0811 12:39:47.497828 (+ 11176us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.497836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.497864 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:39:47.497957 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.497963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.498053 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.498198 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:47.498807 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.499988 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.502108 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.503137 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.503290 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.503350 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.503730 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.503839 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11001,"thread_start_us":10863,"threads_started":1}
I20260811 12:39:47.504313 2673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.486372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43479 (local address 127.0.186.67:52343)
0811 12:39:47.497360 (+ 10988us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:47.497398 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:47.497612 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:47.498221 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:47.498224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:47.498275 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:47.498619 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.498632 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.500192 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.500198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.501915 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.501929 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.503341 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.503349 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.503539 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.503592 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 12:39:47.503706 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 12:39:47.503852 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10737,"mutex_wait_us":1,"thread_start_us":11398,"threads_started":1}
I20260811 12:39:47.505119 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.486411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:43885 (local address 127.0.186.67:42737)
0811 12:39:47.498167 (+ 11756us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:47.498192 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:47.498357 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:47.498852 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:47.498858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:47.498902 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:47.499397 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.499411 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.500858 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.500863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.502446 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.502462 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.504237 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.504245 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.504469 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.504510 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 12:39:47.504594 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 12:39:47.504759 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11582,"spinlock_wait_cycles":31616,"thread_start_us":10552,"threads_started":1}
I20260811 12:39:47.505393 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.486491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:42737 (local address 127.0.186.66:43885)
0811 12:39:47.497051 (+ 10560us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.497060 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.498301 (+ 1241us) server_negotiation.cc:407] Connection header received
0811 12:39:47.498520 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.498527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.498621 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.498738 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:47.499588 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.500673 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.502621 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.503976 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.504164 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.504703 (+ 539us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.504815 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.504917 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10369,"thread_start_us":10201,"threads_started":1}
I20260811 12:39:47.505398 2227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e654f8121454fa987c5991386e8db2d" candidate_uuid: "25acdda1c6174413b152893f0f8e4605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4bd099117145a9871fb5dab2590fe6" is_pre_election: true
I20260811 12:39:47.505887 2227 raft_consensus.cc:2454] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25acdda1c6174413b152893f0f8e4605 in term 0.
I20260811 12:39:47.506058 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e654f8121454fa987c5991386e8db2d" candidate_uuid: "25acdda1c6174413b152893f0f8e4605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b4201ab85c428d85a76958c4cabb37" is_pre_election: true
I20260811 12:39:47.506350 2390 raft_consensus.cc:2454] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25acdda1c6174413b152893f0f8e4605 in term 0.
I20260811 12:39:47.506587 2464 leader_election.cc:302] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25acdda1c6174413b152893f0f8e4605, ec4bd099117145a9871fb5dab2590fe6; no voters:
I20260811 12:39:47.507041 2634 raft_consensus.cc:2781] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:47.507185 2634 raft_consensus.cc:482] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:47.507302 2634 raft_consensus.cc:3037] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:47.509701 2634 raft_consensus.cc:504] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.510423 2634 leader_election.cc:288] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [CANDIDATE]: Term 1 election: Requested vote from peers ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65:43479), 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885)
I20260811 12:39:47.510947 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e654f8121454fa987c5991386e8db2d" candidate_uuid: "25acdda1c6174413b152893f0f8e4605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b4201ab85c428d85a76958c4cabb37"
I20260811 12:39:47.510972 2227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e654f8121454fa987c5991386e8db2d" candidate_uuid: "25acdda1c6174413b152893f0f8e4605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4bd099117145a9871fb5dab2590fe6"
I20260811 12:39:47.511209 2227 raft_consensus.cc:3037] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:47.511234 2390 raft_consensus.cc:3037] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:47.513370 2390 raft_consensus.cc:2454] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25acdda1c6174413b152893f0f8e4605 in term 1.
I20260811 12:39:47.513665 2227 raft_consensus.cc:2454] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25acdda1c6174413b152893f0f8e4605 in term 1.
I20260811 12:39:47.513861 2461 leader_election.cc:302] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b4201ab85c428d85a76958c4cabb37, 25acdda1c6174413b152893f0f8e4605; no voters:
I20260811 12:39:47.514214 2634 raft_consensus.cc:2781] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:47.514755 2634 raft_consensus.cc:686] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [term 1 LEADER]: Becoming Leader. State: Replica: 25acdda1c6174413b152893f0f8e4605, State: Running, Role: LEADER
I20260811 12:39:47.515173 2634 consensus_queue.cc:237] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } }
I20260811 12:39:47.517199 2676 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: TxnStatusTablet state changed. Reason: New leader 25acdda1c6174413b152893f0f8e4605. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.517625 2676 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:39:47.519199 2046 catalog_manager.cc:5495] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25acdda1c6174413b152893f0f8e4605 (127.0.186.67). New cstate: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } health_report { overall_health: HEALTHY } } }
I20260811 12:39:47.518517 2679 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 12:39:47.519949 2679 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 12:39:47.563796 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.556315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33261 (local address 127.0.0.1:35148)
0811 12:39:47.556682 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:47.556715 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:47.556932 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:47.557574 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:47.557577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:47.557588 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:39:47.557787 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.557794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.559544 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.559549 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.560700 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.560714 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.561833 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.561838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.562069 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.562132 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:39:47.563319 (+ 1187us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:39:47.563340 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 12:39:47.563422 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 12:39:47.563550 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 12:39:47.564116 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.556294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35148 (local address 127.0.186.67:33261)
0811 12:39:47.557100 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.557107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.557151 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:39:47.557254 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.557259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.557371 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.557550 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:47.557951 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.559396 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.560925 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.561644 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.561782 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.562378 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:47.563194 (+ 816us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:47.563359 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.563465 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.563562 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":457,"threads_started":1}
I20260811 12:39:47.569399 2390 raft_consensus.cc:1261] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Refusing update from remote peer 25acdda1c6174413b152893f0f8e4605: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:47.569535 2227 raft_consensus.cc:1261] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Refusing update from remote peer 25acdda1c6174413b152893f0f8e4605: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:47.570247 2676 consensus_queue.cc:1035] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:47.570605 2634 consensus_queue.cc:1035] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:47.578740 2638 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: TxnStatusTablet state changed. Reason: New leader 25acdda1c6174413b152893f0f8e4605. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.579092 2638 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.580492 2635 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: TxnStatusTablet state changed. Reason: New leader 25acdda1c6174413b152893f0f8e4605. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.582515 2635 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.583432 2669 mvcc.cc:205] Tried to move back new op lower bound from 7317307341075689472 to 7317307340865675264. Current Snapshot: MvccSnapshot[applied={T|T < 7317307341075689472}]
I20260811 12:39:47.584662 2638 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.584966 2638 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P ec4bd099117145a9871fb5dab2590fe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.585040 2671 mvcc.cc:205] Tried to move back new op lower bound from 7317307341075689472 to 7317307340865675264. Current Snapshot: MvccSnapshot[applied={T|T < 7317307341075689472}]
I20260811 12:39:47.589883 2635 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.590154 2635 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 05b4201ab85c428d85a76958c4cabb37: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:47.591140 2676 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.592803 2676 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:39:47.593149 2676 tablet_replica.cc:439] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25acdda1c6174413b152893f0f8e4605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4bd099117145a9871fb5dab2590fe6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43479 } } peers { permanent_uuid: "05b4201ab85c428d85a76958c4cabb37" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43885 } } peers { permanent_uuid: "25acdda1c6174413b152893f0f8e4605" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33261 } } }
I20260811 12:39:47.596836 2676 tablet_replica.cc:442] T 9e654f8121454fa987c5991386e8db2d P 25acdda1c6174413b152893f0f8e4605: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:39:47.630051 2695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.622509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33261 (local address 127.0.186.65:34737)
0811 12:39:47.623771 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:47.623789 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:47.623979 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:47.624399 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:47.624412 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:47.624422 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:39:47.624800 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.624812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.626349 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.626354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.627574 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.627589 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.628718 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.628724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.628960 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.629035 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:39:47.629498 (+ 463us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:39:47.629508 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 12:39:47.629577 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 12:39:47.629715 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"thread_start_us":867,"threads_started":1}
I20260811 12:39:47.630052 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.622926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:34737 (local address 127.0.186.67:33261)
0811 12:39:47.623122 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.623128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.623913 (+ 785us) server_negotiation.cc:407] Connection header received
0811 12:39:47.624161 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.624167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.624268 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.624373 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:47.624960 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.626136 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.627742 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.628488 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.628630 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.629234 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:47.629379 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:47.629487 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.629598 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.629697 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 12:39:47.691655 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.682735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:52181 (local address 127.0.186.65:43479)
0811 12:39:47.682963 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.682970 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.684377 (+ 1407us) server_negotiation.cc:407] Connection header received
0811 12:39:47.684575 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.684583 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.684701 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.684831 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:47.685669 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.686833 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.689317 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.689991 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.690090 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.690827 (+ 737us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:47.690965 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:47.691027 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.691253 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.691353 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 12:39:47.692502 2700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.682158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43479 (local address 127.0.186.67:52181)
0811 12:39:47.684235 (+ 2077us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:47.684257 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:47.684416 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:47.685020 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:47.685025 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:47.685039 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:39:47.685434 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.685446 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.687052 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.687057 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.689129 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:47.689151 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.690292 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.690299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:47.690499 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.690586 (+ 87us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:39:47.691116 (+ 530us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:39:47.691126 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 12:39:47.691870 (+ 744us) client_negotiation.cc:240] Negotiation successful
0811 12:39:47.692020 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1850,"thread_start_us":493,"threads_started":1}
I20260811 12:39:47.733806 2045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:47.734087 2045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:47.737543 2045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d0e2157cb2b4aaa94d19bfc49d42d2d: Sending DeleteTablet for 3 replicas of tablet 1d3186b577044c1db27a875e290a14f6
I20260811 12:39:47.738454 2201 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3186b577044c1db27a875e290a14f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:47 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:45782
I20260811 12:39:47.738773 2522 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3186b577044c1db27a875e290a14f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:47 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:35136
I20260811 12:39:47.738997 2360 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3186b577044c1db27a875e290a14f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:47 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:56392
I20260811 12:39:47.744645 2704 tablet_replica.cc:330] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: stopping tablet replica
I20260811 12:39:47.745627 2704 raft_consensus.cc:2229] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:47.747340 2704 raft_consensus.cc:2258] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:47.750344 2704 ts_tablet_manager.cc:1905] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:47.751704 2703 tablet_replica.cc:330] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: stopping tablet replica
I20260811 12:39:47.751734 2702 tablet_replica.cc:330] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: stopping tablet replica
I20260811 12:39:47.751982 2702 raft_consensus.cc:2229] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:39:47.752477 2702 raft_consensus.cc:2258] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:47.752831 2703 raft_consensus.cc:2229] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:47.753530 2703 raft_consensus.cc:2258] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:47.754043 2702 ts_tablet_manager.cc:1905] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:47.755460 2703 ts_tablet_manager.cc:1905] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:47.758766 2704 ts_tablet_manager.cc:1918] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:47.758921 2704 log.cc:1196] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/1d3186b577044c1db27a875e290a14f6
I20260811 12:39:47.759406 2704 ts_tablet_manager.cc:1939] T 1d3186b577044c1db27a875e290a14f6 P 05b4201ab85c428d85a76958c4cabb37: Deleting consensus metadata
I20260811 12:39:47.760738 2028 catalog_manager.cc:4841] TS 05b4201ab85c428d85a76958c4cabb37 (127.0.186.66:43885): tablet 1d3186b577044c1db27a875e290a14f6 (table test-table [id=bdef74b1e21a4cc48ba96976307e8b2e]) successfully deleted
I20260811 12:39:47.766283 2702 ts_tablet_manager.cc:1918] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:47.766459 2702 log.cc:1196] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/1d3186b577044c1db27a875e290a14f6
I20260811 12:39:47.766963 2702 ts_tablet_manager.cc:1939] T 1d3186b577044c1db27a875e290a14f6 P ec4bd099117145a9871fb5dab2590fe6: Deleting consensus metadata
I20260811 12:39:47.767201 2703 ts_tablet_manager.cc:1918] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:47.767403 2703 log.cc:1196] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/1d3186b577044c1db27a875e290a14f6
I20260811 12:39:47.768002 2703 ts_tablet_manager.cc:1939] T 1d3186b577044c1db27a875e290a14f6 P 25acdda1c6174413b152893f0f8e4605: Deleting consensus metadata
I20260811 12:39:47.768349 2031 catalog_manager.cc:4841] TS ec4bd099117145a9871fb5dab2590fe6 (127.0.186.65:43479): tablet 1d3186b577044c1db27a875e290a14f6 (table test-table [id=bdef74b1e21a4cc48ba96976307e8b2e]) successfully deleted
I20260811 12:39:47.769376 2030 catalog_manager.cc:4841] TS 25acdda1c6174413b152893f0f8e4605 (127.0.186.67:33261): tablet 1d3186b577044c1db27a875e290a14f6 (table test-table [id=bdef74b1e21a4cc48ba96976307e8b2e]) successfully deleted
Aug 11 12:39:47 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:47.778663 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.749580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.0.186.65:43479)
0811 12:39:47.749827 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.749837 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.757662 (+ 7825us) server_negotiation.cc:407] Connection header received
0811 12:39:47.757998 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.758004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.758090 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.758167 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:47.761812 (+ 3645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.763010 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.764989 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.765728 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.765831 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.771307 (+ 5476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:47.771326 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:47.771347 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:47.771397 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:47.775289 (+ 3892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.776039 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.776050 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.776053 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.776272 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.776819 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.776823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.776825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.777344 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:47.777735 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.778063 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.778301 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 12:39:47.779399 2273 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45796
I20260811 12:39:47.798208 2709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.782534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51696 (local address 127.0.186.126:34101)
0811 12:39:47.785239 (+ 2705us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.785244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.785260 (+ 16us) server_negotiation.cc:407] Connection header received
0811 12:39:47.785313 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.785316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.785378 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.785505 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:47.786947 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.787917 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.789307 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.789744 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.789890 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.792286 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:47.792291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:47.792294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:47.792328 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:47.795121 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.795943 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.795949 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.795953 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.796142 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.796593 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.796598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.796601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.797008 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:47.797288 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.797532 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.797786 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2591,"thread_start_us":2404,"threads_started":1}
W20260811 12:39:47.798950 2045 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51696
I20260811 12:39:47.800793 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2124
I20260811 12:39:47.814872 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.801806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45802 (local address 127.0.186.65:43479)
0811 12:39:47.802019 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.802029 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.802520 (+ 491us) server_negotiation.cc:407] Connection header received
0811 12:39:47.802700 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.802706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.802797 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.802906 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:47.804079 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.804886 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.806063 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.806485 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.806631 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.809029 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:47.809037 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:47.809046 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:47.809080 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:47.812098 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.812791 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.812798 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.812804 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.812942 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.813338 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.813343 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.813347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.813661 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:47.813957 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.814251 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.814506 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 12:39:47.815478 2273 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45802
W20260811 12:39:47.816059 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2124: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:39:47.816252 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 2124
I20260811 12:39:47.857451 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2282
Aug 11 12:39:47 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:39:47.877781 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.858427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56406 (local address 127.0.186.66:43885)
0811 12:39:47.858634 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.858639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.858658 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:39:47.858976 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.858981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.859055 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.859147 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:47.860992 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.861826 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.863724 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.864165 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.864280 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.870496 (+ 6216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:47.870515 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:47.870531 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:47.870579 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:47.873793 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.874588 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.874596 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.874599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.874755 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.875164 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.875169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.875172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.875941 (+ 769us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:47.876423 (+ 482us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.877005 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.877224 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 12:39:47.878499 2434 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56406
W20260811 12:39:47.879226 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2282: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:39:47.879418 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 2282
I20260811 12:39:47.906380 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2443
Aug 11 12:39:47 dist-test-slave-qg60 krb5kdc[1993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:39:47.924257 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:47.907249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35162 (local address 127.0.186.67:33261)
0811 12:39:47.907465 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:47.907471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:47.907543 (+ 72us) server_negotiation.cc:407] Connection header received
0811 12:39:47.907767 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:47.907773 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:47.907873 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:47.908010 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:47.909484 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.910441 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.911882 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:47.912391 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:47.912545 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:47.917190 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:47.917204 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:47.917220 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:47.917266 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:47.920850 (+ 3584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.921717 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.921727 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.921730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.921914 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:47.922355 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:47.922359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:47.922363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:47.922798 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:47.923154 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:47.923541 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 12:39:47.923813 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 12:39:47.925103 2593 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35162
W20260811 12:39:47.925953 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2443: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:39:47.926151 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 2443
I20260811 12:39:47.957628 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2009
I20260811 12:39:47.958968 2091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:48.094614 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 2009
2026-08-11T12:39:48Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5594 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:39:48 dist-test-slave-qg60 krb5kdc[2716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:39:48 dist-test-slave-qg60 krb5kdc[2716](info): set up 2 sockets
Aug 11 12:39:48 dist-test-slave-qg60 krb5kdc[2716](info): commencing operation
krb5kdc: starting...
W20260811 12:39:49.315160 745 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:39:49 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:39:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:39:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:39:49.569272 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:40181
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:40181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:49.916940 2730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:49.917318 2730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:49.917491 2730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:49.925060 2730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:39:49.925227 2730 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 12:39:49.925330 2730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:49.925458 2730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:49.925549 2730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:39:49.925643 2730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:39:49.936232 2730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:40181
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:40181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:49.937695 2730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:49.939165 2730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:49.952139 2738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:49.952150 2740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:49.952940 2736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:49.953265 2730 server_base.cc:1034] running on GCE node
I20260811 12:39:49.954185 2730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:49.955768 2730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:49.957075 2730 hybrid_clock.cc:648] HybridClock initialized: now 1786451989957009 us; error 41 us; skew 500 ppm
I20260811 12:39:49.957479 2730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:49 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451989, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:49.967444 2730 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:39:49.969165 2730 webserver.cc:460] Webserver started at http://127.0.186.126:40055/ using document root <none> and password file <none>
I20260811 12:39:49.969986 2730 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:49.970083 2730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:49.970379 2730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:49.973623 2730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "be1bf360516b4402a588b28baacc8577"
format_stamp: "Formatted at 2026-08-11 12:39:49 on dist-test-slave-qg60"
server_key: "4b822640d1aae7708e1c667025830e91"
server_key_iv: "da84f890457252b55aad652ff9dfcb83"
server_key_version: "encryptionkey@0"
I20260811 12:39:49.974387 2730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "be1bf360516b4402a588b28baacc8577"
format_stamp: "Formatted at 2026-08-11 12:39:49 on dist-test-slave-qg60"
server_key: "4b822640d1aae7708e1c667025830e91"
server_key_iv: "da84f890457252b55aad652ff9dfcb83"
server_key_version: "encryptionkey@0"
I20260811 12:39:49.979974 2730 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 12:39:49.983758 2747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:49.985394 2730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:39:49.985555 2730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "be1bf360516b4402a588b28baacc8577"
format_stamp: "Formatted at 2026-08-11 12:39:49 on dist-test-slave-qg60"
server_key: "4b822640d1aae7708e1c667025830e91"
server_key_iv: "da84f890457252b55aad652ff9dfcb83"
server_key_version: "encryptionkey@0"
I20260811 12:39:49.985756 2730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:50.003985 2730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:50.009044 2730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:50.009305 2730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:50.035089 2730 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:40181
I20260811 12:39:50.035110 2819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:40181 every 8 connection(s)
I20260811 12:39:50.036710 2730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:39:50.040696 2820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:50.044480 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 2730
I20260811 12:39:50.044719 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:39:50.045444 745 external_mini_cluster.cc:1428] Setting key 61a80c6afb80cd5aa4364c5a0fa924bb
I20260811 12:39:50.052256 2820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Bootstrap starting.
I20260811 12:39:50.056229 2820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:50.057484 2820 log.cc:824] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:50.061283 2820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: No bootstrap required, opened a new log
Aug 11 12:39:50 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:50.072696 2824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:50.047592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59004 (local address 127.0.186.126:40181)
0811 12:39:50.048449 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:50.048464 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:50.048509 (+ 45us) server_negotiation.cc:407] Connection header received
0811 12:39:50.050737 (+ 2228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:50.050763 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:50.051168 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:50.051517 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:50.053503 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.054840 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.056674 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.057459 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.057628 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:50.062656 (+ 5028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:50.062667 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:50.062689 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:50.062740 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:50.067246 (+ 4506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:50.068002 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:50.068013 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:50.068023 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:50.068278 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:50.068705 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:50.068710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:50.068713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:50.069844 (+ 1131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:50.070236 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:50.070652 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 12:39:50.071191 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":397,"threads_started":1}
I20260811 12:39:50.072889 2820 raft_consensus.cc:348] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be1bf360516b4402a588b28baacc8577" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40181 } }
I20260811 12:39:50.073381 2820 raft_consensus.cc:374] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:50.073525 2820 raft_consensus.cc:729] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be1bf360516b4402a588b28baacc8577, State: Initialized, Role: FOLLOWER
I20260811 12:39:50.074122 2820 consensus_queue.cc:260] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be1bf360516b4402a588b28baacc8577" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40181 } }
I20260811 12:39:50.074398 2820 raft_consensus.cc:388] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:39:50.074568 2820 raft_consensus.cc:482] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:39:50.074779 2820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:50.077420 2820 raft_consensus.cc:504] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be1bf360516b4402a588b28baacc8577" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40181 } }
I20260811 12:39:50.077932 2820 leader_election.cc:302] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be1bf360516b4402a588b28baacc8577; no voters:
I20260811 12:39:50.078598 2820 leader_election.cc:288] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:39:50.078751 2826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:50.079625 2826 raft_consensus.cc:686] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [term 1 LEADER]: Becoming Leader. State: Replica: be1bf360516b4402a588b28baacc8577, State: Running, Role: LEADER
I20260811 12:39:50.080334 2826 consensus_queue.cc:237] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be1bf360516b4402a588b28baacc8577" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40181 } }
I20260811 12:39:50.081086 2820 sys_catalog.cc:564] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:39:50.083386 2828 sys_catalog.cc:455] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be1bf360516b4402a588b28baacc8577. Latest consensus state: current_term: 1 leader_uuid: "be1bf360516b4402a588b28baacc8577" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be1bf360516b4402a588b28baacc8577" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40181 } } }
I20260811 12:39:50.083806 2828 sys_catalog.cc:458] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:50.084445 2827 sys_catalog.cc:455] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be1bf360516b4402a588b28baacc8577" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be1bf360516b4402a588b28baacc8577" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40181 } } }
I20260811 12:39:50.084796 2827 sys_catalog.cc:458] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577 [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:50.085068 2833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:39:50.094091 2833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:39:50.103770 2833 catalog_manager.cc:1347] Generated new cluster ID: aa85c24a943c490eb33b688dbd88a6a8
I20260811 12:39:50.103904 2833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:39:50.119927 2833 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:39:50.121398 2833 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:39:50.128950 2833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Generated new TSK 0
I20260811 12:39:50.130165 2833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:39:50.199224 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40181
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:50.567673 2852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:50.568006 2852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:50.568190 2852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:50.576228 2852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:50.576359 2852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:50.576538 2852 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 12:39:50.576610 2852 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:39:50.576723 2852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:39:50.587499 2852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:40181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:50.589033 2852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:50.590480 2852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:50.604470 2859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:50.604394 2861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:50.604970 2858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:50.605420 2852 server_base.cc:1034] running on GCE node
I20260811 12:39:50.606091 2852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:50.607167 2852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:50.608431 2852 hybrid_clock.cc:648] HybridClock initialized: now 1786451990608377 us; error 47 us; skew 500 ppm
I20260811 12:39:50.608907 2852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:50 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451990, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:50.612340 2852 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:39:50.614071 2852 webserver.cc:460] Webserver started at http://127.0.186.65:46149/ using document root <none> and password file <none>
I20260811 12:39:50.614841 2852 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:50.615007 2852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:50.615340 2852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:50.618485 2852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "9b7ee9648e08408fbd345ce2e184c38a"
format_stamp: "Formatted at 2026-08-11 12:39:50 on dist-test-slave-qg60"
server_key: "991e10acf4d0e75fa70c254472f2bc12"
server_key_iv: "060e197d5500376a015236a56c0d77a9"
server_key_version: "encryptionkey@0"
I20260811 12:39:50.619341 2852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "9b7ee9648e08408fbd345ce2e184c38a"
format_stamp: "Formatted at 2026-08-11 12:39:50 on dist-test-slave-qg60"
server_key: "991e10acf4d0e75fa70c254472f2bc12"
server_key_iv: "060e197d5500376a015236a56c0d77a9"
server_key_version: "encryptionkey@0"
I20260811 12:39:50.625085 2852 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 12:39:50.629307 2868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:50.631752 2852 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:39:50.631953 2852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "9b7ee9648e08408fbd345ce2e184c38a"
format_stamp: "Formatted at 2026-08-11 12:39:50 on dist-test-slave-qg60"
server_key: "991e10acf4d0e75fa70c254472f2bc12"
server_key_iv: "060e197d5500376a015236a56c0d77a9"
server_key_version: "encryptionkey@0"
I20260811 12:39:50.632246 2852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:50.653622 2852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:50.657931 2852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:50.658200 2852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:50.661120 2852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:50.661224 2852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:50.661398 2852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:50.661552 2852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:39:50 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451990, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:50.691448 2879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:50.661732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:43213 (local address 127.0.186.126:40181)
0811 12:39:50.664860 (+ 3128us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:50.664865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:50.664887 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:39:50.667412 (+ 2525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:50.667418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:50.667494 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:50.667598 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:50.670513 (+ 2915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.671503 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.675027 (+ 3524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.675692 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.675865 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:50.682167 (+ 6302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:50.682179 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:50.682186 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:50.682243 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:50.686348 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:50.687558 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:50.687564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:50.687568 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:50.687780 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:50.688542 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:50.688546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:50.688549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:50.689056 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:50.689237 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:50.690480 (+ 1243us) server_negotiation.cc:299] Negotiation successful
0811 12:39:50.690825 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2965,"thread_start_us":2857,"threads_started":1}
I20260811 12:39:50.692211 2880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:50.662603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.186.65:43213)
0811 12:39:50.663771 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:50.663829 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:50.666971 (+ 3142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:50.667953 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:50.667967 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:50.669107 (+ 1140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:50.670223 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:50.670263 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.671739 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.671752 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:50.674807 (+ 3055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:50.674830 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.676224 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.676230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:50.676471 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:50.677540 (+ 1069us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:50.677594 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:50.681810 (+ 4216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:50.686593 (+ 4783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:50.686612 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:50.686634 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:50.687403 (+ 769us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:50.687940 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:50.687949 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:50.687956 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:50.688358 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:50.689334 (+ 976us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:50.689342 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:50.689822 (+ 480us) client_negotiation.cc:769] Sending connection context
0811 12:39:50.690262 (+ 440us) client_negotiation.cc:240] Negotiation successful
0811 12:39:50.690744 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"thread_start_us":494,"threads_started":1}
I20260811 12:39:50.719159 2852 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:40423
I20260811 12:39:50.719269 3008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:40423 every 8 connection(s)
I20260811 12:39:50.720706 2852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:39:50.723557 3009 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40181
I20260811 12:39:50.723822 3009 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:50.724432 2879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:50.706300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:42963 (local address 127.0.186.126:40181)
0811 12:39:50.706582 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:50.706591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:50.707764 (+ 1173us) server_negotiation.cc:407] Connection header received
0811 12:39:50.708045 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:50.708052 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:50.708136 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:50.708259 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:50.709619 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.710960 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.713709 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.714239 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.714355 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:50.717456 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:50.717461 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:50.717464 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:50.717501 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:50.721095 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:50.722117 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:50.722123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:50.722126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:50.722255 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:50.722716 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:50.722722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:50.722726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:50.723136 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:50.723366 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:50.723814 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 12:39:50.724049 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 12:39:50.724668 2982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:50.706958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.186.65:42963)
0811 12:39:50.707630 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:50.707652 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:50.707851 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:50.708288 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:50.708293 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:50.709037 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:50.709452 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:50.709463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.711169 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.711178 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:50.713490 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:50.713516 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:50.714479 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:50.714488 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:50.714737 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:50.715673 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:50.715700 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:50.717242 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:50.721240 (+ 3998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:50.721249 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:50.721256 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:50.721959 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:50.722380 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:50.722385 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:50.722388 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:50.722584 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:50.723286 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:50.723290 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:50.723506 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 12:39:50.723696 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 12:39:50.724052 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":381,"threads_started":1}
I20260811 12:39:50.724869 3009 heartbeater.cc:511] Master 127.0.186.126:40181 requested a full tablet report, sending...
I20260811 12:39:50.725629 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 2852
I20260811 12:39:50.725849 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:39:50.726670 745 external_mini_cluster.cc:1428] Setting key b3343a86defacd758d260f6e58d89638
I20260811 12:39:50.727483 2768 ts_manager.cc:194] Registered new tserver with Master: 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423)
I20260811 12:39:50.729723 2768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:43213
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:39:50.781257 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40181
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:51.138202 3013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:51.138557 3013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:51.138772 3013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:51.146449 3013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:51.146606 3013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:51.146777 3013 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 12:39:51.146870 3013 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:39:51.147017 3013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:39:51.157481 3013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:40181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:51.159053 3013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:51.160519 3013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:51.175078 3019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:51.175384 3018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:51.175213 3021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:51.176533 3013 server_base.cc:1034] running on GCE node
I20260811 12:39:51.177273 3013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:51.178272 3013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:51.179519 3013 hybrid_clock.cc:648] HybridClock initialized: now 1786451991179470 us; error 42 us; skew 500 ppm
I20260811 12:39:51.179903 3013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:51 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:51.183421 3013 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:39:51.185196 3013 webserver.cc:460] Webserver started at http://127.0.186.66:46659/ using document root <none> and password file <none>
I20260811 12:39:51.185940 3013 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:51.186100 3013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:51.186443 3013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:51.189752 3013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "2bd62173de154d03969d120b2cfc6089"
format_stamp: "Formatted at 2026-08-11 12:39:51 on dist-test-slave-qg60"
server_key: "f7cdc7e55a75cd15cc70d37cc5cd013b"
server_key_iv: "35d631acabeac26cef6b7b5fcf91e3c1"
server_key_version: "encryptionkey@0"
I20260811 12:39:51.190644 3013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "2bd62173de154d03969d120b2cfc6089"
format_stamp: "Formatted at 2026-08-11 12:39:51 on dist-test-slave-qg60"
server_key: "f7cdc7e55a75cd15cc70d37cc5cd013b"
server_key_iv: "35d631acabeac26cef6b7b5fcf91e3c1"
server_key_version: "encryptionkey@0"
I20260811 12:39:51.196357 3013 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260811 12:39:51.200075 3028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:51.201604 3013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:39:51.201788 3013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "2bd62173de154d03969d120b2cfc6089"
format_stamp: "Formatted at 2026-08-11 12:39:51 on dist-test-slave-qg60"
server_key: "f7cdc7e55a75cd15cc70d37cc5cd013b"
server_key_iv: "35d631acabeac26cef6b7b5fcf91e3c1"
server_key_version: "encryptionkey@0"
I20260811 12:39:51.202003 3013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:51.214453 3013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:51.218755 3013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:51.219125 3013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:51.221994 3013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:51.222157 3013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:51.222316 3013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:51.222416 3013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:39:51 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:51.248772 2879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.222475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:33093 (local address 127.0.186.126:40181)
0811 12:39:51.222687 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.222693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.224189 (+ 1496us) server_negotiation.cc:407] Connection header received
0811 12:39:51.226621 (+ 2432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.226632 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.226750 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.226874 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:51.229337 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.230524 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.233603 (+ 3079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.234050 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.234206 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.239841 (+ 5635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:51.239846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:51.239850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:51.239887 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:51.244316 (+ 4429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.245358 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.245366 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.245371 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.245555 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.246296 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.246304 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.246311 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.246816 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:51.247042 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.247833 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.248172 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:39:51.249637 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.223009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.186.66:33093)
0811 12:39:51.223969 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.224028 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.226287 (+ 2259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.227179 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.227190 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.228040 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:51.229102 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.229145 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.230729 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.230739 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.233420 (+ 2681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.233439 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.234342 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.234349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.234615 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.235620 (+ 1005us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:51.235659 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:51.239554 (+ 3895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:51.244502 (+ 4948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.244510 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.244523 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.245132 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.245702 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.245708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.245712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.246075 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.246993 (+ 918us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:51.247000 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:51.247390 (+ 390us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.247658 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.248097 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":398,"threads_started":1}
I20260811 12:39:51.277591 2879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.260119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:47671 (local address 127.0.186.126:40181)
0811 12:39:51.260389 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.260399 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.261131 (+ 732us) server_negotiation.cc:407] Connection header received
0811 12:39:51.261356 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.261360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.261429 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.261519 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:51.263084 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.264049 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.266355 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.266980 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.267063 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.269786 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:51.269795 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:51.269802 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:51.269859 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:51.274168 (+ 4309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.275209 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.275221 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.275224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.275369 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.275896 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.275901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.275904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.276350 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:51.276527 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.276996 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.277237 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:39:51.277760 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.260096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.186.66:47671)
0811 12:39:51.260982 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.261016 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.261215 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.261597 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.261604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.262434 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:51.262911 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.262928 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.264222 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.264228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.266131 (+ 1903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.266155 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.267443 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.267451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.267635 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.268421 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:51.268440 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:51.269456 (+ 1016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:51.274352 (+ 4896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.274360 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.274367 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.275043 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.275499 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.275505 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.275508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.275738 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.276479 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:51.276482 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:51.276666 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.276880 (+ 214us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.277288 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":423,"threads_started":1}
I20260811 12:39:51.282407 3013 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:35439
I20260811 12:39:51.282457 3166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:35439 every 8 connection(s)
I20260811 12:39:51.283682 3013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:39:51.285833 3167 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40181
I20260811 12:39:51.286095 3167 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:51.286418 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 3013
I20260811 12:39:51.286600 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:39:51.286913 3167 heartbeater.cc:511] Master 127.0.186.126:40181 requested a full tablet report, sending...
I20260811 12:39:51.287137 745 external_mini_cluster.cc:1428] Setting key dde7edcf705fe73fe65af956efe72b11
I20260811 12:39:51.288480 2767 ts_manager.cc:194] Registered new tserver with Master: 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439)
I20260811 12:39:51.289551 2767 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:33093
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:39:51.345512 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40181
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:51.703032 3171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:51.703353 3171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:51.703462 3171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:51.711061 3171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:51.711179 3171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:51.711265 3171 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 12:39:51.711320 3171 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:39:51.711390 3171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:39:51.723310 3171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:40181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:51.724968 3171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:51.726387 3171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 12:39:51.732903 3009 heartbeater.cc:503] Master 127.0.186.126:40181 was elected leader, sending a full tablet report...
W20260811 12:39:51.741032 3176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:51.741081 3177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:51.741320 3179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:51.742103 3171 server_base.cc:1034] running on GCE node
I20260811 12:39:51.742810 3171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:51.743731 3171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:51.744941 3171 hybrid_clock.cc:648] HybridClock initialized: now 1786451991744870 us; error 53 us; skew 500 ppm
I20260811 12:39:51.745234 3171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:51 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:51.748528 3171 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:39:51.750347 3171 webserver.cc:460] Webserver started at http://127.0.186.67:41125/ using document root <none> and password file <none>
I20260811 12:39:51.751056 3171 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:51.751209 3171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:51.751595 3171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:51.754755 3171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "3bc7d8e6d604438180c7c23c26351626"
format_stamp: "Formatted at 2026-08-11 12:39:51 on dist-test-slave-qg60"
server_key: "3f4dc4633685044ac5a3587b927c9c00"
server_key_iv: "1954f935f1fb3a750fe7110edbb3f252"
server_key_version: "encryptionkey@0"
I20260811 12:39:51.755604 3171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "3bc7d8e6d604438180c7c23c26351626"
format_stamp: "Formatted at 2026-08-11 12:39:51 on dist-test-slave-qg60"
server_key: "3f4dc4633685044ac5a3587b927c9c00"
server_key_iv: "1954f935f1fb3a750fe7110edbb3f252"
server_key_version: "encryptionkey@0"
I20260811 12:39:51.761073 3171 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 12:39:51.764883 3187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:51.766538 3171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:39:51.766767 3171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "3bc7d8e6d604438180c7c23c26351626"
format_stamp: "Formatted at 2026-08-11 12:39:51 on dist-test-slave-qg60"
server_key: "3f4dc4633685044ac5a3587b927c9c00"
server_key_iv: "1954f935f1fb3a750fe7110edbb3f252"
server_key_version: "encryptionkey@0"
I20260811 12:39:51.767027 3171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:51.784950 3171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:51.789237 3171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:51.789547 3171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:51.792495 3171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:51.792654 3171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:51.792845 3171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:51.792958 3171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:39:51 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:51.817871 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.793621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.186.67:43911)
0811 12:39:51.794512 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.794610 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.796835 (+ 2225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.797638 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.797650 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.798461 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:51.799450 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.799482 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.801521 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.801528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.803752 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.803766 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.804658 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.804667 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.804996 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.805964 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:51.806010 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:51.808546 (+ 2536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:51.812456 (+ 3910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.812469 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.812494 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.813172 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.813701 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.813710 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.813715 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.814055 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.814922 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:51.814931 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:51.815545 (+ 614us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.815883 (+ 338us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.816422 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":352,"threads_started":1}
I20260811 12:39:51.817948 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.792872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:43911 (local address 127.0.186.126:40181)
0811 12:39:51.793430 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.793438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.794765 (+ 1327us) server_negotiation.cc:407] Connection header received
0811 12:39:51.797149 (+ 2384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.797156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.797257 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.797383 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:51.799788 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.801292 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.803936 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.804386 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.804536 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.808856 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:51.808864 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:51.808868 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:51.808928 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:51.812273 (+ 3345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.813405 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.813411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.813415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.813593 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.814243 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.814246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.814249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.814692 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:51.814853 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.817022 (+ 2169us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.817365 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":315,"threads_started":1}
I20260811 12:39:51.842168 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.824706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:41945 (local address 127.0.186.126:40181)
0811 12:39:51.824901 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.824905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.825795 (+ 890us) server_negotiation.cc:407] Connection header received
0811 12:39:51.826006 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.826011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.826095 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.826213 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:51.827698 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.828840 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.831592 (+ 2752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.832167 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.832319 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.835415 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:51.835424 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:51.835429 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:51.835473 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:51.839247 (+ 3774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.839998 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.840004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.840008 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.840160 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.840557 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.840563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.840566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.840927 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:51.841111 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.841529 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.841790 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 12:39:51.842316 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.824878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.186.67:41945)
0811 12:39:51.825684 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.825701 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.825872 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.826246 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.826250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.826995 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:51.827502 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.827521 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.829018 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.829023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.831409 (+ 2386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.831424 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.832658 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.832669 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.832930 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.833741 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:51.833772 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:51.835087 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:51.839397 (+ 4310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.839402 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.839406 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.839860 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.840286 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:51.840291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:51.840295 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:51.840439 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:51.841059 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:51.841067 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:51.841277 (+ 210us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.841427 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.841799 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":522,"threads_started":1}
I20260811 12:39:51.849804 3171 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:45599
I20260811 12:39:51.849858 3322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:45599 every 8 connection(s)
I20260811 12:39:51.851135 3171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:39:51.853446 3323 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40181
I20260811 12:39:51.853719 3323 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:51.854442 3323 heartbeater.cc:511] Master 127.0.186.126:40181 requested a full tablet report, sending...
I20260811 12:39:51.855986 2767 ts_manager.cc:194] Registered new tserver with Master: 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:51.856958 2767 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:43911
I20260811 12:39:51.860129 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 3171
I20260811 12:39:51.860273 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:39:51.860688 745 external_mini_cluster.cc:1428] Setting key 1567ee491caf2e60ef897251b856b62a
I20260811 12:39:51.863824 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 12:39:51 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 12:39:51 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:51.923343 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.907843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59010 (local address 127.0.186.126:40181)
0811 12:39:51.908110 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.908115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.908271 (+ 156us) server_negotiation.cc:407] Connection header received
0811 12:39:51.908433 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.908438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.908521 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.908611 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:51.910068 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.910804 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.912279 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.912686 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.912840 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.917550 (+ 4710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:51.917555 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:51.917558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:51.917596 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:51.920477 (+ 2881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.921252 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.921256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.921259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.921444 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:51.921855 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:51.921859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:51.921861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:51.922206 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:51.922442 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.922688 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.922876 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 12:39:51.927994 2767 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:51.935240 2767 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:51.961947 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.948287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:35439 (local address 127.0.0.1:45184)
0811 12:39:51.949237 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.949282 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.949434 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.950600 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.950610 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.950647 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:51.951069 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.951088 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.953761 (+ 2673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.953770 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.957235 (+ 3465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.957258 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.960292 (+ 3034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.960302 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.960630 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.960710 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.960937 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.961286 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":1,"thread_start_us":436,"threads_started":1}
I20260811 12:39:51.962368 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.949618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:40423 (local address 127.0.0.1:55288)
0811 12:39:51.950216 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.950244 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.950461 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.951710 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.951717 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.951755 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:51.952316 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.952332 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.955111 (+ 2779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.955120 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.958228 (+ 3108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.958251 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.960981 (+ 2730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.960990 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.961311 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.961367 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.961467 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.961682 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":36,"thread_start_us":295,"threads_started":1}
I20260811 12:39:51.963394 3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.948456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45184 (local address 127.0.186.66:35439)
0811 12:39:51.949266 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.949276 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.949381 (+ 105us) server_negotiation.cc:407] Connection header received
0811 12:39:51.949682 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.949695 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.950008 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.950270 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:51.951380 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.953532 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.957525 (+ 3993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.959581 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.959765 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.960073 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.962680 (+ 2607us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.962960 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":480,"threads_started":1}
I20260811 12:39:51.963922 3343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.949983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55288 (local address 127.0.186.65:40423)
0811 12:39:51.950973 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.950982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.951010 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:39:51.951120 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.951128 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.951418 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.952584 (+ 1166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:51.952880 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.954900 (+ 2020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.958525 (+ 3625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.960617 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.962855 (+ 2238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.963153 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.963231 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.963410 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":662,"threads_started":1}
I20260811 12:39:51.968458 3086 tablet_service.cc:1467] Processing CreateTablet for tablet 91a689214c40438aa9504df90c18b818 (DEFAULT_TABLE table=test-table [id=3cf70ebafb544f199fdd720fa4c0a863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:51.968458 2929 tablet_service.cc:1467] Processing CreateTablet for tablet 91a689214c40438aa9504df90c18b818 (DEFAULT_TABLE table=test-table [id=3cf70ebafb544f199fdd720fa4c0a863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:51.970033 2929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a689214c40438aa9504df90c18b818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:51.970059 3086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a689214c40438aa9504df90c18b818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:51.970769 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.951077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45599 (local address 127.0.0.1:57564)
0811 12:39:51.962270 (+ 11193us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:51.962293 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:51.962430 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:51.965113 (+ 2683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:51.965118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:51.965147 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:51.965321 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.965333 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.966846 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.966854 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.968464 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:51.968476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.969953 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.969959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:51.970179 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.970222 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 12:39:51.970316 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 12:39:51.970464 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11096,"thread_start_us":12249,"threads_started":1}
I20260811 12:39:51.971601 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:51.950817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57564 (local address 127.0.186.67:45599)
0811 12:39:51.964355 (+ 13538us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:51.964361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:51.964392 (+ 31us) server_negotiation.cc:407] Connection header received
0811 12:39:51.964526 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:51.964535 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:51.964874 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:51.965107 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:51.965492 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.966664 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.968637 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:51.969784 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:51.969939 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:51.970185 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:51.971046 (+ 861us) server_negotiation.cc:299] Negotiation successful
0811 12:39:51.971226 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13375,"thread_start_us":13161,"threads_started":1}
I20260811 12:39:51.975057 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 91a689214c40438aa9504df90c18b818 (DEFAULT_TABLE table=test-table [id=3cf70ebafb544f199fdd720fa4c0a863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:51.976492 3246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91a689214c40438aa9504df90c18b818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:51.987635 3346 tablet_bootstrap.cc:492] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Bootstrap starting.
I20260811 12:39:51.988087 3347 tablet_bootstrap.cc:492] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Bootstrap starting.
I20260811 12:39:51.988799 3348 tablet_bootstrap.cc:492] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Bootstrap starting.
I20260811 12:39:51.991886 3347 tablet_bootstrap.cc:654] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:51.992098 3346 tablet_bootstrap.cc:654] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:51.992311 3348 tablet_bootstrap.cc:654] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:51.993526 3348 log.cc:824] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:51.993515 3346 log.cc:824] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:51.994150 3347 log.cc:824] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:52.000345 3347 tablet_bootstrap.cc:492] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: No bootstrap required, opened a new log
I20260811 12:39:52.000419 3348 tablet_bootstrap.cc:492] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: No bootstrap required, opened a new log
I20260811 12:39:52.000407 3346 tablet_bootstrap.cc:492] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: No bootstrap required, opened a new log
I20260811 12:39:52.000751 3346 ts_tablet_manager.cc:1397] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260811 12:39:52.000721 3348 ts_tablet_manager.cc:1397] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260811 12:39:52.000701 3347 ts_tablet_manager.cc:1397] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.003s
I20260811 12:39:52.009393 3347 raft_consensus.cc:348] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.009840 3347 raft_consensus.cc:374] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.009987 3347 raft_consensus.cc:729] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.010664 3347 consensus_queue.cc:260] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.011840 3167 heartbeater.cc:503] Master 127.0.186.126:40181 was elected leader, sending a full tablet report...
I20260811 12:39:52.012166 3348 raft_consensus.cc:348] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.012637 3347 ts_tablet_manager.cc:1428] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260811 12:39:52.012631 3348 raft_consensus.cc:374] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.012759 3348 raft_consensus.cc:729] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc7d8e6d604438180c7c23c26351626, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.013046 3346 raft_consensus.cc:348] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.013527 3346 raft_consensus.cc:374] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.013666 3346 raft_consensus.cc:729] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b7ee9648e08408fbd345ce2e184c38a, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.013537 3348 consensus_queue.cc:260] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.014384 3346 consensus_queue.cc:260] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.016929 3346 ts_tablet_manager.cc:1428] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent starting tablet: real 0.016s user 0.014s sys 0.001s
I20260811 12:39:52.022967 3323 heartbeater.cc:503] Master 127.0.186.126:40181 was elected leader, sending a full tablet report...
I20260811 12:39:52.023826 3348 ts_tablet_manager.cc:1428] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Time spent starting tablet: real 0.023s user 0.010s sys 0.009s
W20260811 12:39:52.035848 3168 tablet.cc:2369] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:52.095041 3352 raft_consensus.cc:482] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:52.095412 3352 raft_consensus.cc:504] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.097339 3352 leader_election.cc:288] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
W20260811 12:39:52.102902 3324 tablet.cc:2369] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:52.105646 3343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.098027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:54547 (local address 127.0.186.65:40423)
0811 12:39:52.098295 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.098303 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.098627 (+ 324us) server_negotiation.cc:407] Connection header received
0811 12:39:52.098890 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.098896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.099013 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.099137 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:52.099831 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.100865 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.103321 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.104476 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.104681 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.104794 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.105159 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.105316 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:39:52.105712 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.098771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:44315 (local address 127.0.186.67:45599)
0811 12:39:52.098990 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.098999 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.099582 (+ 583us) server_negotiation.cc:407] Connection header received
0811 12:39:52.099775 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.099781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.099862 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.100054 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:52.100575 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.101463 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.103781 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.104588 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.104867 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.104954 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.105306 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.105444 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 12:39:52.105859 3357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.098606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45599 (local address 127.0.186.66:44315)
0811 12:39:52.099462 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.099479 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.099622 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.100066 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.100069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.100090 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:52.100406 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.100413 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.101609 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.101614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.103624 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.103637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.104944 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.104950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.105147 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.105171 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.105276 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.105406 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"mutex_wait_us":1,"thread_start_us":454,"threads_started":1}
I20260811 12:39:52.106158 3356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.097811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:40423 (local address 127.0.186.66:54547)
0811 12:39:52.098469 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.098485 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.098698 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.099186 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.099193 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.099232 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:52.099680 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.099695 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.100992 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.100995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.103136 (+ 2141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.103151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.104693 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.104699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.104986 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.105014 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.105133 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.105272 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":48,"thread_start_us":347,"threads_started":1}
I20260811 12:39:52.107144 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a689214c40438aa9504df90c18b818" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a" is_pre_election: true
I20260811 12:39:52.107118 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a689214c40438aa9504df90c18b818" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626" is_pre_election: true
I20260811 12:39:52.107681 2951 raft_consensus.cc:2454] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:52.107681 3272 raft_consensus.cc:2454] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:52.108449 3030 leader_election.cc:302] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 3bc7d8e6d604438180c7c23c26351626; no voters:
I20260811 12:39:52.109011 3352 raft_consensus.cc:2781] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:52.109272 3352 raft_consensus.cc:482] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:52.109419 3352 raft_consensus.cc:3037] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.111824 3352 raft_consensus.cc:504] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.112461 3352 leader_election.cc:288] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Requested vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:52.113128 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a689214c40438aa9504df90c18b818" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a"
I20260811 12:39:52.113200 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91a689214c40438aa9504df90c18b818" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626"
I20260811 12:39:52.113348 2951 raft_consensus.cc:3037] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.113454 3272 raft_consensus.cc:3037] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.115768 2951 raft_consensus.cc:2454] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 1.
I20260811 12:39:52.115783 3272 raft_consensus.cc:2454] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 1.
I20260811 12:39:52.116216 3030 leader_election.cc:302] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 3bc7d8e6d604438180c7c23c26351626; no voters:
I20260811 12:39:52.116588 3352 raft_consensus.cc:2781] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:52.117213 3352 raft_consensus.cc:686] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Running, Role: LEADER
I20260811 12:39:52.117823 3352 consensus_queue.cc:237] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.123548 2767 catalog_manager.cc:5495] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd62173de154d03969d120b2cfc6089 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "2bd62173de154d03969d120b2cfc6089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } health_report { overall_health: UNKNOWN } } }
Aug 11 12:39:52 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451989, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:52.198515 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.183683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40181 (local address 127.0.0.1:59020)
0811 12:39:52.184298 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.184314 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.184494 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.184953 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.184957 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.185695 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:52.186010 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.186021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.187049 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.187053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.188155 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.188167 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.189085 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.189091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.189222 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.189962 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:52.189986 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:52.192596 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:52.196035 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:52.196048 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:52.196054 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:52.196528 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:52.196977 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:52.196981 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:52.196983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:52.197138 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:52.197636 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:52.197643 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:52.197807 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.197944 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.198172 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":337,"threads_started":1}
I20260811 12:39:52.198601 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.183689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59020 (local address 127.0.186.126:40181)
0811 12:39:52.183880 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.183903 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.184412 (+ 509us) server_negotiation.cc:407] Connection header received
0811 12:39:52.184620 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.184625 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.184692 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.184841 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:52.186168 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.186885 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.188302 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.188815 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.188932 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.192884 (+ 3952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:52.192889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:52.192893 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:52.192924 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:52.195855 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:52.196659 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:52.196663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:52.196665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:52.196868 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:52.197236 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:52.197240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:52.197242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:52.197506 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:52.197611 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.198072 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.198321 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":67}
I20260811 12:39:52.204489 2767 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:59020:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 12:39:52.205768 2767 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:52.212872 2929 tablet_service.cc:1467] Processing CreateTablet for tablet b7ab2b6dd8554ab09c016034d70aa8b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eed4704dcde14d66935055f9a12cde5e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:39:52.212879 3086 tablet_service.cc:1467] Processing CreateTablet for tablet b7ab2b6dd8554ab09c016034d70aa8b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eed4704dcde14d66935055f9a12cde5e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:39:52.213001 3246 tablet_service.cc:1467] Processing CreateTablet for tablet b7ab2b6dd8554ab09c016034d70aa8b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eed4704dcde14d66935055f9a12cde5e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:39:52.213779 2929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7ab2b6dd8554ab09c016034d70aa8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:52.213835 3246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7ab2b6dd8554ab09c016034d70aa8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:52.213835 3086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7ab2b6dd8554ab09c016034d70aa8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:52.219532 3346 tablet_bootstrap.cc:492] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: Bootstrap starting.
I20260811 12:39:52.221439 3346 tablet_bootstrap.cc:654] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:52.221448 3347 tablet_bootstrap.cc:492] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: Bootstrap starting.
I20260811 12:39:52.221638 3348 tablet_bootstrap.cc:492] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: Bootstrap starting.
I20260811 12:39:52.223277 3347 tablet_bootstrap.cc:654] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:52.223587 3348 tablet_bootstrap.cc:654] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: Neither blocks nor log segments found. Creating new log.
W20260811 12:39:52.224270 3010 tablet.cc:2369] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:39:52.225014 3346 tablet_bootstrap.cc:492] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: No bootstrap required, opened a new log
I20260811 12:39:52.225303 3346 ts_tablet_manager.cc:1397] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 12:39:52.226478 3346 raft_consensus.cc:348] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.226945 3346 raft_consensus.cc:374] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.227077 3346 raft_consensus.cc:729] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b7ee9648e08408fbd345ce2e184c38a, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.227368 3346 consensus_queue.cc:260] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.227958 3354 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.228297 3348 tablet_bootstrap.cc:492] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: No bootstrap required, opened a new log
I20260811 12:39:52.228399 3354 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.228451 3348 ts_tablet_manager.cc:1397] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260811 12:39:52.229141 3347 tablet_bootstrap.cc:492] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: No bootstrap required, opened a new log
I20260811 12:39:52.229343 3347 ts_tablet_manager.cc:1397] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260811 12:39:52.229388 3346 ts_tablet_manager.cc:1428] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 12:39:52.229311 3348 raft_consensus.cc:348] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.229617 3348 raft_consensus.cc:374] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.229784 3348 raft_consensus.cc:729] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc7d8e6d604438180c7c23c26351626, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.230090 3348 consensus_queue.cc:260] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.230309 3347 raft_consensus.cc:348] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.230594 3347 raft_consensus.cc:374] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.230722 3347 raft_consensus.cc:729] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.230801 3348 ts_tablet_manager.cc:1428] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 12:39:52.230631 3353 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.231025 3353 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.230979 3347 consensus_queue.cc:260] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.231627 3347 ts_tablet_manager.cc:1428] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 12:39:52.232513 3352 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.232800 3352 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.235462 3353 raft_consensus.cc:482] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:52.235723 3353 raft_consensus.cc:504] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.237589 3353 leader_election.cc:288] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439)
I20260811 12:39:52.244364 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.237959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:40423 (local address 127.0.186.67:38007)
0811 12:39:52.238177 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.238199 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.238333 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.238729 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.238737 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.238778 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:52.239075 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.239090 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.240318 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.240327 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.241693 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.241708 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.243509 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.243518 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.243752 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.243779 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.243897 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.244069 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 12:39:52.244405 3343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.238005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:38007 (local address 127.0.186.65:40423)
0811 12:39:52.238175 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.238180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.238253 (+ 73us) server_negotiation.cc:407] Connection header received
0811 12:39:52.238482 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.238491 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.238578 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.238682 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:52.239242 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.240182 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.242061 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.243315 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.243537 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.243630 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.243927 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.244069 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 12:39:52.245779 3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.238678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:53425 (local address 127.0.186.66:35439)
0811 12:39:52.238877 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.238882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.239781 (+ 899us) server_negotiation.cc:407] Connection header received
0811 12:39:52.239876 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.239881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.239948 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.240039 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:52.240583 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.241373 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.243671 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.244714 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.244877 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.244941 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.245465 (+ 524us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.245589 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:39:52.245828 3372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.238417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:35439 (local address 127.0.186.67:53425)
0811 12:39:52.239678 (+ 1261us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.239693 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.239789 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.240057 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.240060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.240077 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:52.240426 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.240433 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.241517 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.241522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.243485 (+ 1963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.243500 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.245139 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.245144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.245299 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.245326 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.245410 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.245522 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1139,"thread_start_us":978,"threads_started":1}
I20260811 12:39:52.248529 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ab2b6dd8554ab09c016034d70aa8b3" candidate_uuid: "3bc7d8e6d604438180c7c23c26351626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a" is_pre_election: true
I20260811 12:39:52.248878 2951 raft_consensus.cc:2454] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bc7d8e6d604438180c7c23c26351626 in term 0.
I20260811 12:39:52.248840 3109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ab2b6dd8554ab09c016034d70aa8b3" candidate_uuid: "3bc7d8e6d604438180c7c23c26351626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd62173de154d03969d120b2cfc6089" is_pre_election: true
I20260811 12:39:52.249470 3109 raft_consensus.cc:2454] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bc7d8e6d604438180c7c23c26351626 in term 0.
I20260811 12:39:52.249465 3189 leader_election.cc:302] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bc7d8e6d604438180c7c23c26351626, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:52.250001 3353 raft_consensus.cc:2781] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:52.250150 3353 raft_consensus.cc:482] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:52.250265 3353 raft_consensus.cc:3037] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.253199 3353 raft_consensus.cc:504] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.253904 3353 leader_election.cc:288] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [CANDIDATE]: Term 1 election: Requested vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439)
I20260811 12:39:52.254495 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ab2b6dd8554ab09c016034d70aa8b3" candidate_uuid: "3bc7d8e6d604438180c7c23c26351626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a"
I20260811 12:39:52.254601 3109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ab2b6dd8554ab09c016034d70aa8b3" candidate_uuid: "3bc7d8e6d604438180c7c23c26351626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd62173de154d03969d120b2cfc6089"
I20260811 12:39:52.254792 2951 raft_consensus.cc:3037] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.254868 3109 raft_consensus.cc:3037] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.257185 2951 raft_consensus.cc:2454] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bc7d8e6d604438180c7c23c26351626 in term 1.
I20260811 12:39:52.257663 3189 leader_election.cc:302] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bc7d8e6d604438180c7c23c26351626, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:52.257925 3109 raft_consensus.cc:2454] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bc7d8e6d604438180c7c23c26351626 in term 1.
I20260811 12:39:52.258061 3353 raft_consensus.cc:2781] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:52.258690 3353 raft_consensus.cc:686] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [term 1 LEADER]: Becoming Leader. State: Replica: 3bc7d8e6d604438180c7c23c26351626, State: Running, Role: LEADER
I20260811 12:39:52.259300 3353 consensus_queue.cc:237] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.263229 3373 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: TxnStatusTablet state changed. Reason: New leader 3bc7d8e6d604438180c7c23c26351626. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.263792 3373 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:39:52.264683 3376 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 12:39:52.265156 3376 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 12:39:52.265357 2767 catalog_manager.cc:5495] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67). New cstate: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } health_report { overall_health: HEALTHY } } }
I20260811 12:39:52.296008 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.287610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.0.186.67:45599)
0811 12:39:52.287801 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.287808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.288189 (+ 381us) server_negotiation.cc:407] Connection header received
0811 12:39:52.288482 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.288488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.288601 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.288866 (+ 265us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:52.289344 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.290747 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.292866 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.293632 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.293779 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.294386 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.295230 (+ 844us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.295399 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.295539 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.295638 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 12:39:52.296021 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.287651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45599 (local address 127.0.0.1:57578)
0811 12:39:52.288065 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.288086 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.288244 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.288902 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.288908 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.288922 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:39:52.289156 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.289168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.290957 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.290963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.292655 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.292673 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.293847 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.293854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.294073 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.294159 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.295348 (+ 1189us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.295396 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.295499 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.295681 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211}
I20260811 12:39:52.305815 3109 raft_consensus.cc:1261] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Refusing update from remote peer 3bc7d8e6d604438180c7c23c26351626: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:52.305852 2951 raft_consensus.cc:1261] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Refusing update from remote peer 3bc7d8e6d604438180c7c23c26351626: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:52.306886 3373 consensus_queue.cc:1035] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:52.307283 3353 consensus_queue.cc:1035] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:52.320067 3354 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: TxnStatusTablet state changed. Reason: New leader 3bc7d8e6d604438180c7c23c26351626. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.320482 3354 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.321415 3352 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: TxnStatusTablet state changed. Reason: New leader 3bc7d8e6d604438180c7c23c26351626. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.321798 3352 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.324419 3379 mvcc.cc:205] Tried to move back new op lower bound from 7317307360473047040 to 7317307360298430464. Current Snapshot: MvccSnapshot[applied={T|T < 7317307360473047040}]
I20260811 12:39:52.325021 3353 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.325480 3353 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:39:52.325737 3353 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.326069 3353 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 3bc7d8e6d604438180c7c23c26351626: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:39:52.336395 3354 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.336831 3354 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 9b7ee9648e08408fbd345ce2e184c38a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.346599 3352 tablet_replica.cc:439] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3bc7d8e6d604438180c7c23c26351626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } } }
I20260811 12:39:52.346987 3352 tablet_replica.cc:442] T b7ab2b6dd8554ab09c016034d70aa8b3 P 2bd62173de154d03969d120b2cfc6089: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:39:52.357007 3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.349886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.0.186.66:35439)
0811 12:39:52.350071 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.350076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.350263 (+ 187us) server_negotiation.cc:407] Connection header received
0811 12:39:52.350480 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.350484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.350562 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.350700 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:52.351141 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.352275 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.354437 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.354994 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.355097 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.355765 (+ 668us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.356293 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.356402 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.356576 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.356659 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:39:52.376346 3391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.369708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45599 (local address 127.0.186.66:38755)
0811 12:39:52.370525 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.370542 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.370667 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.371126 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.371129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.371139 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:39:52.371456 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.371463 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.372989 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.372994 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.374090 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.374102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.375203 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.375208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.375327 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.375381 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.375875 (+ 494us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.375884 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.375949 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.376056 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":426,"threads_started":1}
I20260811 12:39:52.376379 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.369805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:38755 (local address 127.0.186.67:45599)
0811 12:39:52.370022 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.370030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.370639 (+ 609us) server_negotiation.cc:407] Connection header received
0811 12:39:52.370800 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.370805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.370973 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.371081 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:52.371702 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.372845 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.374271 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.375011 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.375147 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.375640 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.375771 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.375873 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.375999 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.376083 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 12:39:52.387420 2951 raft_consensus.cc:1261] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:52.387665 3272 raft_consensus.cc:1261] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:52.388137 3358 consensus_queue.cc:1035] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:52.389124 3358 consensus_queue.cc:1035] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:52.394899 3380 mvcc.cc:205] Tried to move back new op lower bound from 7317307360812273664 to 7317307359719448576. Current Snapshot: MvccSnapshot[applied={T|T < 7317307360812273664}]
I20260811 12:39:52.398450 3381 mvcc.cc:205] Tried to move back new op lower bound from 7317307360812273664 to 7317307359719448576. Current Snapshot: MvccSnapshot[applied={T|T < 7317307360812273664}]
I20260811 12:39:52.429792 3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.421775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:49847 (local address 127.0.186.66:35439)
0811 12:39:52.421976 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:52.421983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:52.422673 (+ 690us) server_negotiation.cc:407] Connection header received
0811 12:39:52.422943 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:52.422949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:52.423045 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:52.423149 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:52.424090 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.424974 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.427407 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.428174 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.428282 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.429113 (+ 831us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.429225 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.429303 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:52.429463 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 12:39:52.429532 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:39:52.430092 3396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:52.421758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:35439 (local address 127.0.186.67:49847)
0811 12:39:52.422563 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:52.422581 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:52.422752 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:52.423333 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:52.423339 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:52.423356 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:39:52.423845 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.423865 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.425127 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.425134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.427205 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:52.427222 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:52.428525 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:52.428538 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:52.428768 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:52.428864 (+ 96us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:39:52.429340 (+ 476us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:39:52.429353 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 12:39:52.429451 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 12:39:52.429634 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":408,"threads_started":1}
I20260811 12:39:52.476926 2767 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:52.477263 2767 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:52.481823 2767 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Sending DeleteTablet for 3 replicas of tablet 91a689214c40438aa9504df90c18b818
I20260811 12:39:52.483330 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a689214c40438aa9504df90c18b818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:52 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57564
I20260811 12:39:52.483376 2929 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a689214c40438aa9504df90c18b818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:52 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:55288
I20260811 12:39:52.484417 3086 tablet_service.cc:1514] Processing DeleteTablet for tablet 91a689214c40438aa9504df90c18b818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:52 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:45184
I20260811 12:39:52.488574 2768 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:52.489394 2768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:52.500293 2928 tablet_service.cc:1467] Processing CreateTablet for tablet 52af403e47c7461fb78b63367a0081ea (DEFAULT_TABLE table=test-table [id=915ee6179bfa4f0393e3017710713cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:52.500865 3085 tablet_service.cc:1467] Processing CreateTablet for tablet 52af403e47c7461fb78b63367a0081ea (DEFAULT_TABLE table=test-table [id=915ee6179bfa4f0393e3017710713cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:52.500970 2928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52af403e47c7461fb78b63367a0081ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:52.501473 3085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52af403e47c7461fb78b63367a0081ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:52.504534 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 52af403e47c7461fb78b63367a0081ea (DEFAULT_TABLE table=test-table [id=915ee6179bfa4f0393e3017710713cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:52.505192 3245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52af403e47c7461fb78b63367a0081ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:52.511683 3347 tablet_bootstrap.cc:492] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Bootstrap starting.
I20260811 12:39:52.513726 3347 tablet_bootstrap.cc:654] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:52.514531 3346 tablet_bootstrap.cc:492] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Bootstrap starting.
I20260811 12:39:52.516378 3346 tablet_bootstrap.cc:654] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:52.520229 3348 tablet_bootstrap.cc:492] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Bootstrap starting.
I20260811 12:39:52.522289 3348 tablet_bootstrap.cc:654] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:52.530049 3347 tablet_bootstrap.cc:492] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: No bootstrap required, opened a new log
I20260811 12:39:52.530383 3347 ts_tablet_manager.cc:1397] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.010s
I20260811 12:39:52.531428 3347 raft_consensus.cc:348] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.531899 3347 raft_consensus.cc:374] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.532052 3347 raft_consensus.cc:729] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.532469 3347 consensus_queue.cc:260] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.533507 3347 ts_tablet_manager.cc:1428] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 12:39:52.533566 3346 tablet_bootstrap.cc:492] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: No bootstrap required, opened a new log
I20260811 12:39:52.533857 3346 ts_tablet_manager.cc:1397] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.001s
I20260811 12:39:52.534806 3346 raft_consensus.cc:348] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.535187 3346 raft_consensus.cc:374] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.535617 3397 raft_consensus.cc:482] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:52.535894 3346 raft_consensus.cc:729] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b7ee9648e08408fbd345ce2e184c38a, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.535804 3397 raft_consensus.cc:504] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.536617 3397 leader_election.cc:288] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:52.536468 3346 consensus_queue.cc:260] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.537539 3346 ts_tablet_manager.cc:1428] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:52.537698 3271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52af403e47c7461fb78b63367a0081ea" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626" is_pre_election: true
W20260811 12:39:52.539644 3030 leader_election.cc:341] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599): Illegal state: must be running to vote when last-logged opid is not known
I20260811 12:39:52.542086 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52af403e47c7461fb78b63367a0081ea" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a" is_pre_election: true
I20260811 12:39:52.542341 2951 raft_consensus.cc:2454] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:52.542882 3030 leader_election.cc:302] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 9b7ee9648e08408fbd345ce2e184c38a; no voters: 3bc7d8e6d604438180c7c23c26351626
I20260811 12:39:52.544324 3397 raft_consensus.cc:2781] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:52.544472 3397 raft_consensus.cc:482] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:52.544582 3397 raft_consensus.cc:3037] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.548635 3397 raft_consensus.cc:504] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.550050 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52af403e47c7461fb78b63367a0081ea" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a"
I20260811 12:39:52.550294 2951 raft_consensus.cc:3037] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.553885 2951 raft_consensus.cc:2454] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 1.
I20260811 12:39:52.554569 3030 leader_election.cc:302] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:52.554962 3358 raft_consensus.cc:2781] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:52.555120 3358 raft_consensus.cc:686] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Running, Role: LEADER
I20260811 12:39:52.555423 3358 consensus_queue.cc:237] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.559562 3271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52af403e47c7461fb78b63367a0081ea" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626"
W20260811 12:39:52.560335 3030 leader_election.cc:341] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599): Illegal state: must be running to vote when last-logged opid is not known
I20260811 12:39:52.560868 3397 leader_election.cc:288] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Requested vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:52.564914 3403 tablet_replica.cc:330] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: stopping tablet replica
I20260811 12:39:52.567238 3348 tablet_bootstrap.cc:492] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: No bootstrap required, opened a new log
I20260811 12:39:52.569235 3348 ts_tablet_manager.cc:1397] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.023s
I20260811 12:39:52.570250 3401 tablet_replica.cc:330] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: stopping tablet replica
I20260811 12:39:52.570693 3403 raft_consensus.cc:2229] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:39:52.570032 3400 tablet_replica.cc:330] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: stopping tablet replica
I20260811 12:39:52.571810 3400 raft_consensus.cc:2229] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:52.572053 3401 raft_consensus.cc:2229] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:52.572374 3403 raft_consensus.cc:2258] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:52.573020 3401 raft_consensus.cc:2258] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:52.572908 3348 raft_consensus.cc:348] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.573168 3348 raft_consensus.cc:374] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:52.573257 3348 raft_consensus.cc:729] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc7d8e6d604438180c7c23c26351626, State: Initialized, Role: FOLLOWER
I20260811 12:39:52.573529 3348 consensus_queue.cc:260] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:52.574168 3348 ts_tablet_manager.cc:1428] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260811 12:39:52.572178 3400 raft_consensus.cc:2258] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:52.576289 2767 catalog_manager.cc:5495] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd62173de154d03969d120b2cfc6089 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "2bd62173de154d03969d120b2cfc6089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } health_report { overall_health: UNKNOWN } } }
I20260811 12:39:52.577399 3400 ts_tablet_manager.cc:1905] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:52.585620 3401 ts_tablet_manager.cc:1905] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:52.586164 3400 ts_tablet_manager.cc:1918] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:52.586392 3400 log.cc:1196] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/91a689214c40438aa9504df90c18b818
I20260811 12:39:52.587037 3400 ts_tablet_manager.cc:1939] T 91a689214c40438aa9504df90c18b818 P 3bc7d8e6d604438180c7c23c26351626: Deleting consensus metadata
I20260811 12:39:52.589082 2749 catalog_manager.cc:4841] TS 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599): tablet 91a689214c40438aa9504df90c18b818 (table test-table [id=3cf70ebafb544f199fdd720fa4c0a863]) successfully deleted
I20260811 12:39:52.591778 3403 ts_tablet_manager.cc:1905] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:52.598743 3401 ts_tablet_manager.cc:1918] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:52.605273 3401 log.cc:1196] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/91a689214c40438aa9504df90c18b818
I20260811 12:39:52.606065 3401 ts_tablet_manager.cc:1939] T 91a689214c40438aa9504df90c18b818 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting consensus metadata
I20260811 12:39:52.609269 3403 ts_tablet_manager.cc:1918] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:52.609576 3403 log.cc:1196] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/91a689214c40438aa9504df90c18b818
I20260811 12:39:52.609632 2749 catalog_manager.cc:4841] TS 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423): tablet 91a689214c40438aa9504df90c18b818 (table test-table [id=3cf70ebafb544f199fdd720fa4c0a863]) successfully deleted
I20260811 12:39:52.610234 3403 ts_tablet_manager.cc:1939] T 91a689214c40438aa9504df90c18b818 P 2bd62173de154d03969d120b2cfc6089: Deleting consensus metadata
I20260811 12:39:52.612058 2749 catalog_manager.cc:4841] TS 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439): tablet 91a689214c40438aa9504df90c18b818 (table test-table [id=3cf70ebafb544f199fdd720fa4c0a863]) successfully deleted
I20260811 12:39:52.617216 3271 raft_consensus.cc:3037] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:52.618772 2951 raft_consensus.cc:1261] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:52.619493 3397 consensus_queue.cc:1035] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:52.621105 3271 raft_consensus.cc:1261] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:52.621711 3397 consensus_queue.cc:1035] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 12:39:52.678267 3381 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 12:39:54.327802 2768 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:54.328037 2768 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:54.332453 2768 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Sending DeleteTablet for 3 replicas of tablet 52af403e47c7461fb78b63367a0081ea
I20260811 12:39:54.333531 2929 tablet_service.cc:1514] Processing DeleteTablet for tablet 52af403e47c7461fb78b63367a0081ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:54 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:55288
I20260811 12:39:54.333549 3086 tablet_service.cc:1514] Processing DeleteTablet for tablet 52af403e47c7461fb78b63367a0081ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:54 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:45184
I20260811 12:39:54.333735 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 52af403e47c7461fb78b63367a0081ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:54 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57564
I20260811 12:39:54.346670 3433 tablet_replica.cc:330] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: stopping tablet replica
I20260811 12:39:54.347209 3433 raft_consensus.cc:2229] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:54.347641 3433 raft_consensus.cc:2258] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:54.348402 3434 tablet_replica.cc:330] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: stopping tablet replica
I20260811 12:39:54.348682 3434 raft_consensus.cc:2229] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:39:54.349028 3433 ts_tablet_manager.cc:1905] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:54.349298 3434 raft_consensus.cc:2258] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:54.350379 3434 ts_tablet_manager.cc:1905] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:54.356199 3433 ts_tablet_manager.cc:1918] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 12:39:54.356762 3436 tablet_replica.cc:330] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: stopping tablet replica
I20260811 12:39:54.356897 3433 log.cc:1196] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/52af403e47c7461fb78b63367a0081ea
I20260811 12:39:54.357084 3436 raft_consensus.cc:2229] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:54.357425 3436 raft_consensus.cc:2258] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:54.357446 3434 ts_tablet_manager.cc:1918] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 12:39:54.357524 3433 ts_tablet_manager.cc:1939] T 52af403e47c7461fb78b63367a0081ea P 9b7ee9648e08408fbd345ce2e184c38a: Deleting consensus metadata
I20260811 12:39:54.357569 3434 log.cc:1196] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/52af403e47c7461fb78b63367a0081ea
I20260811 12:39:54.358043 3434 ts_tablet_manager.cc:1939] T 52af403e47c7461fb78b63367a0081ea P 2bd62173de154d03969d120b2cfc6089: Deleting consensus metadata
I20260811 12:39:54.358779 3436 ts_tablet_manager.cc:1905] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:54.358999 2749 catalog_manager.cc:4841] TS 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423): tablet 52af403e47c7461fb78b63367a0081ea (table test-table [id=915ee6179bfa4f0393e3017710713cbb]) successfully deleted
I20260811 12:39:54.359428 2749 catalog_manager.cc:4841] TS 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439): tablet 52af403e47c7461fb78b63367a0081ea (table test-table [id=915ee6179bfa4f0393e3017710713cbb]) successfully deleted
I20260811 12:39:54.364017 3436 ts_tablet_manager.cc:1918] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 12:39:54.364200 3436 log.cc:1196] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/52af403e47c7461fb78b63367a0081ea
I20260811 12:39:54.364596 3436 ts_tablet_manager.cc:1939] T 52af403e47c7461fb78b63367a0081ea P 3bc7d8e6d604438180c7c23c26351626: Deleting consensus metadata
I20260811 12:39:54.365832 2749 catalog_manager.cc:4841] TS 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599): tablet 52af403e47c7461fb78b63367a0081ea (table test-table [id=915ee6179bfa4f0393e3017710713cbb]) successfully deleted
Aug 11 12:39:54 dist-test-slave-qg60 krb5kdc[2716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 12:39:54 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:54.406605 3445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:54.391540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.0.186.126:40181)
0811 12:39:54.392202 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:54.392210 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:54.392240 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:39:54.392495 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:54.392500 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:54.392571 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:54.392690 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:54.394222 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.395148 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.396528 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.397110 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.397215 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:54.401247 (+ 4032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:54.401252 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:54.401255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:54.401291 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:54.404110 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:54.404716 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:54.404720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:54.404723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:54.404909 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:54.405305 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:54.405308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:54.405310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:54.405650 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:54.405838 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:54.406105 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 12:39:54.406279 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":324,"threads_started":1}
I20260811 12:39:54.410159 2768 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:54.410746 2768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:54.417555 2929 tablet_service.cc:1467] Processing CreateTablet for tablet 12c3544eca254928b03ea5c99034b6f4 (DEFAULT_TABLE table=test-table [id=8e49b6599a064b3f98e5a8e7e1e629cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:54.417764 3086 tablet_service.cc:1467] Processing CreateTablet for tablet 12c3544eca254928b03ea5c99034b6f4 (DEFAULT_TABLE table=test-table [id=8e49b6599a064b3f98e5a8e7e1e629cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:54.418072 2929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12c3544eca254928b03ea5c99034b6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:54.418228 3086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12c3544eca254928b03ea5c99034b6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:54.418308 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 12c3544eca254928b03ea5c99034b6f4 (DEFAULT_TABLE table=test-table [id=8e49b6599a064b3f98e5a8e7e1e629cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:54.418751 3246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12c3544eca254928b03ea5c99034b6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:54.424418 3446 tablet_bootstrap.cc:492] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Bootstrap starting.
I20260811 12:39:54.425617 3448 tablet_bootstrap.cc:492] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Bootstrap starting.
I20260811 12:39:54.426417 3449 tablet_bootstrap.cc:492] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Bootstrap starting.
I20260811 12:39:54.427449 3448 tablet_bootstrap.cc:654] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:54.427448 3446 tablet_bootstrap.cc:654] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:54.428519 3449 tablet_bootstrap.cc:654] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:54.429900 3448 tablet_bootstrap.cc:492] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: No bootstrap required, opened a new log
I20260811 12:39:54.430089 3448 ts_tablet_manager.cc:1397] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 12:39:54.429929 3446 tablet_bootstrap.cc:492] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: No bootstrap required, opened a new log
I20260811 12:39:54.430301 3446 ts_tablet_manager.cc:1397] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 12:39:54.430980 3449 tablet_bootstrap.cc:492] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: No bootstrap required, opened a new log
I20260811 12:39:54.431119 3449 ts_tablet_manager.cc:1397] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 12:39:54.430987 3448 raft_consensus.cc:348] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.431267 3448 raft_consensus.cc:374] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:54.431392 3448 raft_consensus.cc:729] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Initialized, Role: FOLLOWER
I20260811 12:39:54.431246 3446 raft_consensus.cc:348] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.431535 3446 raft_consensus.cc:374] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:54.431645 3446 raft_consensus.cc:729] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b7ee9648e08408fbd345ce2e184c38a, State: Initialized, Role: FOLLOWER
I20260811 12:39:54.431643 3448 consensus_queue.cc:260] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.431923 3446 consensus_queue.cc:260] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.432052 3449 raft_consensus.cc:348] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.432307 3448 ts_tablet_manager.cc:1428] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 12:39:54.432482 3449 raft_consensus.cc:374] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:54.432691 3449 raft_consensus.cc:729] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc7d8e6d604438180c7c23c26351626, State: Initialized, Role: FOLLOWER
I20260811 12:39:54.433046 3446 ts_tablet_manager.cc:1428] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:54.432991 3449 consensus_queue.cc:260] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.433746 3449 ts_tablet_manager.cc:1428] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 12:39:54.440596 3358 raft_consensus.cc:482] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:54.440980 3358 raft_consensus.cc:504] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.441797 3358 leader_election.cc:288] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:54.442312 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c3544eca254928b03ea5c99034b6f4" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a" is_pre_election: true
I20260811 12:39:54.442467 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c3544eca254928b03ea5c99034b6f4" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626" is_pre_election: true
I20260811 12:39:54.442624 2951 raft_consensus.cc:2454] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:54.442763 3272 raft_consensus.cc:2454] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:54.443223 3030 leader_election.cc:302] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:54.443570 3358 raft_consensus.cc:2781] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:54.443696 3358 raft_consensus.cc:482] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:54.443813 3358 raft_consensus.cc:3037] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:54.445982 3358 raft_consensus.cc:504] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.446514 3358 leader_election.cc:288] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Requested vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:54.447046 2951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c3544eca254928b03ea5c99034b6f4" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a"
I20260811 12:39:54.447082 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c3544eca254928b03ea5c99034b6f4" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626"
I20260811 12:39:54.447284 2951 raft_consensus.cc:3037] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:54.447299 3272 raft_consensus.cc:3037] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:54.450511 2951 raft_consensus.cc:2454] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 1.
I20260811 12:39:54.450521 3272 raft_consensus.cc:2454] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 1.
I20260811 12:39:54.450922 3030 leader_election.cc:302] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:54.451220 3358 raft_consensus.cc:2781] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:54.451434 3358 raft_consensus.cc:686] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Running, Role: LEADER
I20260811 12:39:54.451725 3358 consensus_queue.cc:237] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.454645 2766 catalog_manager.cc:5495] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd62173de154d03969d120b2cfc6089 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "2bd62173de154d03969d120b2cfc6089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } health_report { overall_health: UNKNOWN } } }
I20260811 12:39:54.476804 3458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:54.471599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35014 (local address 127.0.186.66:35439)
0811 12:39:54.472218 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:54.472222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:54.472242 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:39:54.472293 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:54.472296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:54.472353 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:54.472437 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:39:54.472898 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.473662 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.474987 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.475431 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.475527 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:54.475968 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:39:54.476114 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:39:54.476186 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:54.476321 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 12:39:54.476384 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":339,"threads_started":1}
I20260811 12:39:54.486776 3272 raft_consensus.cc:1261] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:54.487450 3423 consensus_queue.cc:1035] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:54.487762 2951 raft_consensus.cc:1261] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:54.488399 3423 consensus_queue.cc:1035] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:54.536667 2766 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:54.537065 2766 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:54.540269 2766 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Sending DeleteTablet for 3 replicas of tablet 12c3544eca254928b03ea5c99034b6f4
I20260811 12:39:54.541239 2929 tablet_service.cc:1514] Processing DeleteTablet for tablet 12c3544eca254928b03ea5c99034b6f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:54 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:55288
I20260811 12:39:54.541311 3086 tablet_service.cc:1514] Processing DeleteTablet for tablet 12c3544eca254928b03ea5c99034b6f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:54 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:45184
I20260811 12:39:54.541616 3434 tablet_replica.cc:330] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: stopping tablet replica
I20260811 12:39:54.541628 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 12c3544eca254928b03ea5c99034b6f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:54 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57564
I20260811 12:39:54.541855 3434 raft_consensus.cc:2229] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:39:54.541910 3436 tablet_replica.cc:330] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: stopping tablet replica
I20260811 12:39:54.541946 3433 tablet_replica.cc:330] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: stopping tablet replica
I20260811 12:39:54.542073 3436 raft_consensus.cc:2229] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:54.542158 3433 raft_consensus.cc:2229] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:54.542228 3436 raft_consensus.cc:2258] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:54.542294 3434 raft_consensus.cc:2258] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:54.542353 3433 raft_consensus.cc:2258] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:54.543648 3436 ts_tablet_manager.cc:1905] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:54.543680 3434 ts_tablet_manager.cc:1905] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:54.543686 3433 ts_tablet_manager.cc:1905] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:54.545053 2766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:39:54.545908 2766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:39:54.550256 3436 ts_tablet_manager.cc:1918] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:54.550500 3436 log.cc:1196] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/12c3544eca254928b03ea5c99034b6f4
I20260811 12:39:54.550714 3434 ts_tablet_manager.cc:1918] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:54.550922 3434 log.cc:1196] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/12c3544eca254928b03ea5c99034b6f4
I20260811 12:39:54.551363 3436 ts_tablet_manager.cc:1939] T 12c3544eca254928b03ea5c99034b6f4 P 3bc7d8e6d604438180c7c23c26351626: Deleting consensus metadata
I20260811 12:39:54.551558 3434 ts_tablet_manager.cc:1939] T 12c3544eca254928b03ea5c99034b6f4 P 2bd62173de154d03969d120b2cfc6089: Deleting consensus metadata
I20260811 12:39:54.552690 2749 catalog_manager.cc:4841] TS 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599): tablet 12c3544eca254928b03ea5c99034b6f4 (table test-table [id=8e49b6599a064b3f98e5a8e7e1e629cc]) successfully deleted
I20260811 12:39:54.553040 2749 catalog_manager.cc:4841] TS 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439): tablet 12c3544eca254928b03ea5c99034b6f4 (table test-table [id=8e49b6599a064b3f98e5a8e7e1e629cc]) successfully deleted
I20260811 12:39:54.554271 3433 ts_tablet_manager.cc:1918] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:39:54.554494 3433 log.cc:1196] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/12c3544eca254928b03ea5c99034b6f4
I20260811 12:39:54.555097 3433 ts_tablet_manager.cc:1939] T 12c3544eca254928b03ea5c99034b6f4 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting consensus metadata
I20260811 12:39:54.555014 3246 tablet_service.cc:1467] Processing CreateTablet for tablet e48cc3b30e2b401ea88e3a59c2f0e877 (DEFAULT_TABLE table=test-table [id=8928efb7f36e41dabf9c6d7ac085d562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:54.555020 2929 tablet_service.cc:1467] Processing CreateTablet for tablet e48cc3b30e2b401ea88e3a59c2f0e877 (DEFAULT_TABLE table=test-table [id=8928efb7f36e41dabf9c6d7ac085d562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:54.555111 3086 tablet_service.cc:1467] Processing CreateTablet for tablet e48cc3b30e2b401ea88e3a59c2f0e877 (DEFAULT_TABLE table=test-table [id=8928efb7f36e41dabf9c6d7ac085d562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:39:54.555495 3246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e48cc3b30e2b401ea88e3a59c2f0e877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:54.555563 2929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e48cc3b30e2b401ea88e3a59c2f0e877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:54.555608 3086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e48cc3b30e2b401ea88e3a59c2f0e877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:39:54.560216 3449 tablet_bootstrap.cc:492] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Bootstrap starting.
I20260811 12:39:54.562156 3449 tablet_bootstrap.cc:654] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:54.563079 3448 tablet_bootstrap.cc:492] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Bootstrap starting.
I20260811 12:39:54.564356 3446 tablet_bootstrap.cc:492] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Bootstrap starting.
I20260811 12:39:54.564922 3449 tablet_bootstrap.cc:492] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: No bootstrap required, opened a new log
I20260811 12:39:54.564962 3448 tablet_bootstrap.cc:654] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:54.565222 3449 ts_tablet_manager.cc:1397] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 12:39:54.566082 2749 catalog_manager.cc:4841] TS 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423): tablet 12c3544eca254928b03ea5c99034b6f4 (table test-table [id=8e49b6599a064b3f98e5a8e7e1e629cc]) successfully deleted
I20260811 12:39:54.566210 3449 raft_consensus.cc:348] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.566425 3446 tablet_bootstrap.cc:654] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:54.566578 3449 raft_consensus.cc:374] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:54.566680 3449 raft_consensus.cc:729] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc7d8e6d604438180c7c23c26351626, State: Initialized, Role: FOLLOWER
I20260811 12:39:54.567000 3449 consensus_queue.cc:260] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.568226 3449 ts_tablet_manager.cc:1428] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:54.568619 3448 tablet_bootstrap.cc:492] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: No bootstrap required, opened a new log
I20260811 12:39:54.568915 3448 ts_tablet_manager.cc:1397] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.004s
I20260811 12:39:54.569664 3446 tablet_bootstrap.cc:492] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: No bootstrap required, opened a new log
I20260811 12:39:54.569852 3446 ts_tablet_manager.cc:1397] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 12:39:54.569885 3448 raft_consensus.cc:348] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.570154 3448 raft_consensus.cc:374] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:54.570246 3448 raft_consensus.cc:729] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Initialized, Role: FOLLOWER
I20260811 12:39:54.570518 3448 consensus_queue.cc:260] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.571172 3448 ts_tablet_manager.cc:1428] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 12:39:54.571827 3446 raft_consensus.cc:348] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.572249 3446 raft_consensus.cc:374] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:54.572348 3446 raft_consensus.cc:729] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b7ee9648e08408fbd345ce2e184c38a, State: Initialized, Role: FOLLOWER
I20260811 12:39:54.572636 3446 consensus_queue.cc:260] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.573683 3446 ts_tablet_manager.cc:1428] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 12:39:54.684388 3453 raft_consensus.cc:482] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:54.684701 3453 raft_consensus.cc:504] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.686431 3453 leader_election.cc:288] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:54.691093 3358 raft_consensus.cc:482] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:39:54.691351 3358 raft_consensus.cc:504] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.692101 3358 leader_election.cc:288] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:54.692718 2950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a" is_pre_election: true
I20260811 12:39:54.692785 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626" is_pre_election: true
I20260811 12:39:54.693058 3272 raft_consensus.cc:2454] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:54.693075 2950 raft_consensus.cc:2454] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 0.
I20260811 12:39:54.693547 3030 leader_election.cc:302] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:54.693881 3358 raft_consensus.cc:2781] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:54.694015 3358 raft_consensus.cc:482] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:54.694120 3358 raft_consensus.cc:3037] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:54.695262 3458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:54.686873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:36829 (local address 127.0.186.66:35439)
0811 12:39:54.687149 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:54.687156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:54.687484 (+ 328us) server_negotiation.cc:407] Connection header received
0811 12:39:54.687864 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:54.687872 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:54.687991 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:54.688066 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:54.689032 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.690135 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.692925 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.694216 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.694425 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:54.694512 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:54.694837 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 12:39:54.694974 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:39:54.695380 3470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:54.686681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:35439 (local address 127.0.186.65:36829)
0811 12:39:54.687361 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:54.687385 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:54.687612 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:54.688382 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:54.688386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:54.688416 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:54.688805 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:54.688821 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.690304 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.690310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:54.692690 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:54.692710 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.694463 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.694470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:54.694662 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:54.694687 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 12:39:54.694804 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 12:39:54.694956 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":36,"thread_start_us":341,"threads_started":1}
I20260811 12:39:54.696157 3471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:54.687390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45599 (local address 127.0.186.65:48807)
0811 12:39:54.688319 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:54.688338 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:54.688447 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:54.688906 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:54.688913 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:54.688947 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:39:54.689385 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:54.689401 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.690990 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.690996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:54.693091 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:54.693108 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.695224 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.695236 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:54.695485 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:54.695521 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 12:39:54.695624 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 12:39:54.695771 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":1,"spinlock_wait_cycles":4480,"thread_start_us":503,"threads_started":1}
I20260811 12:39:54.696254 3472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:54.687659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:48807 (local address 127.0.186.67:45599)
0811 12:39:54.688535 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:54.688539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:54.688564 (+ 25us) server_negotiation.cc:407] Connection header received
0811 12:39:54.688625 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:54.688628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:54.688682 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:54.688844 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:39:54.689695 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.690808 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.693343 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:54.694797 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:54.694968 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:54.695043 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:54.695760 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 12:39:54.695916 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":592,"threads_started":1}
I20260811 12:39:54.696183 3109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "9b7ee9648e08408fbd345ce2e184c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd62173de154d03969d120b2cfc6089" is_pre_election: true
I20260811 12:39:54.696877 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "9b7ee9648e08408fbd345ce2e184c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626" is_pre_election: true
I20260811 12:39:54.697142 3272 raft_consensus.cc:2454] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b7ee9648e08408fbd345ce2e184c38a in term 0.
I20260811 12:39:54.697641 2870 leader_election.cc:302] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bc7d8e6d604438180c7c23c26351626, 9b7ee9648e08408fbd345ce2e184c38a; no voters:
I20260811 12:39:54.697809 3358 raft_consensus.cc:504] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.698143 3453 raft_consensus.cc:2781] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:39:54.698314 3109 raft_consensus.cc:2379] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b7ee9648e08408fbd345ce2e184c38a in current term 1: Already voted for candidate 2bd62173de154d03969d120b2cfc6089 in this term.
I20260811 12:39:54.698290 3453 raft_consensus.cc:482] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:39:54.698405 3453 raft_consensus.cc:3037] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:54.698998 2950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b7ee9648e08408fbd345ce2e184c38a"
I20260811 12:39:54.699380 3358 leader_election.cc:288] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Requested vote from peers 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:54.700960 3272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "2bd62173de154d03969d120b2cfc6089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626"
I20260811 12:39:54.701169 3272 raft_consensus.cc:3037] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:54.701043 3453 raft_consensus.cc:504] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.701596 2950 raft_consensus.cc:2379] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bd62173de154d03969d120b2cfc6089 in current term 1: Already voted for candidate 9b7ee9648e08408fbd345ce2e184c38a in this term.
I20260811 12:39:54.701831 3453 leader_election.cc:288] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [CANDIDATE]: Term 1 election: Requested vote from peers 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439), 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599)
I20260811 12:39:54.702597 3109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "9b7ee9648e08408fbd345ce2e184c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd62173de154d03969d120b2cfc6089"
I20260811 12:39:54.702642 3271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e48cc3b30e2b401ea88e3a59c2f0e877" candidate_uuid: "9b7ee9648e08408fbd345ce2e184c38a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc7d8e6d604438180c7c23c26351626"
I20260811 12:39:54.702895 3109 raft_consensus.cc:2379] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b7ee9648e08408fbd345ce2e184c38a in current term 1: Already voted for candidate 2bd62173de154d03969d120b2cfc6089 in this term.
I20260811 12:39:54.703316 2870 leader_election.cc:302] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b7ee9648e08408fbd345ce2e184c38a; no voters: 2bd62173de154d03969d120b2cfc6089, 3bc7d8e6d604438180c7c23c26351626
I20260811 12:39:54.703645 3453 raft_consensus.cc:2726] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 12:39:54.704365 3272 raft_consensus.cc:2454] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd62173de154d03969d120b2cfc6089 in term 1.
I20260811 12:39:54.704865 3030 leader_election.cc:302] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bd62173de154d03969d120b2cfc6089, 3bc7d8e6d604438180c7c23c26351626; no voters: 9b7ee9648e08408fbd345ce2e184c38a
I20260811 12:39:54.705163 3358 raft_consensus.cc:2781] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:54.705361 3358 raft_consensus.cc:686] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd62173de154d03969d120b2cfc6089, State: Running, Role: LEADER
I20260811 12:39:54.705690 3358 consensus_queue.cc:237] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } }
I20260811 12:39:54.708492 2766 catalog_manager.cc:5495] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd62173de154d03969d120b2cfc6089 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "2bd62173de154d03969d120b2cfc6089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd62173de154d03969d120b2cfc6089" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 35439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 } health_report { overall_health: UNKNOWN } } }
I20260811 12:39:54.742229 3272 raft_consensus.cc:1261] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:54.742877 3358 consensus_queue.cc:1035] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bc7d8e6d604438180c7c23c26351626" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:39:54.745491 2950 raft_consensus.cc:1261] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Refusing update from remote peer 2bd62173de154d03969d120b2cfc6089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:39:54.746629 3358 consensus_queue.cc:1035] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b7ee9648e08408fbd345ce2e184c38a" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 40423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 12:39:54.769281 3415 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 12:39:56.354872 2766 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:56.355194 2766 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:39:56.361531 2766 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be1bf360516b4402a588b28baacc8577: Sending DeleteTablet for 3 replicas of tablet e48cc3b30e2b401ea88e3a59c2f0e877
I20260811 12:39:56.362643 2929 tablet_service.cc:1514] Processing DeleteTablet for tablet e48cc3b30e2b401ea88e3a59c2f0e877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:56 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:55288
I20260811 12:39:56.362622 3086 tablet_service.cc:1514] Processing DeleteTablet for tablet e48cc3b30e2b401ea88e3a59c2f0e877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:56 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:45184
I20260811 12:39:56.363292 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2852
I20260811 12:39:56.363420 3501 tablet_replica.cc:330] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: stopping tablet replica
I20260811 12:39:56.363620 3502 tablet_replica.cc:330] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: stopping tablet replica
I20260811 12:39:56.363624 3501 raft_consensus.cc:2229] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:39:56.363803 3502 raft_consensus.cc:2229] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:56.363926 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet e48cc3b30e2b401ea88e3a59c2f0e877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:39:56 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57564
I20260811 12:39:56.364032 3502 raft_consensus.cc:2258] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:56.364604 3503 tablet_replica.cc:330] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: stopping tablet replica
I20260811 12:39:56.364885 3503 raft_consensus.cc:2229] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:39:56.365193 3503 raft_consensus.cc:2258] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:56.366274 3502 ts_tablet_manager.cc:1905] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:56.368937 3501 raft_consensus.cc:2258] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:39:56.370112 3501 ts_tablet_manager.cc:1905] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:56.373884 3503 ts_tablet_manager.cc:1905] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:39:56.375298 3501 ts_tablet_manager.cc:1918] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 12:39:56.375478 3501 log.cc:1196] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/e48cc3b30e2b401ea88e3a59c2f0e877
I20260811 12:39:56.376111 3501 ts_tablet_manager.cc:1939] T e48cc3b30e2b401ea88e3a59c2f0e877 P 2bd62173de154d03969d120b2cfc6089: Deleting consensus metadata
I20260811 12:39:56.379108 3502 ts_tablet_manager.cc:1918] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 12:39:56.379351 3502 log.cc:1196] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/e48cc3b30e2b401ea88e3a59c2f0e877
I20260811 12:39:56.379426 2749 catalog_manager.cc:4841] TS 2bd62173de154d03969d120b2cfc6089 (127.0.186.66:35439): tablet e48cc3b30e2b401ea88e3a59c2f0e877 (table test-table [id=8928efb7f36e41dabf9c6d7ac085d562]) successfully deleted
I20260811 12:39:56.379912 3502 ts_tablet_manager.cc:1939] T e48cc3b30e2b401ea88e3a59c2f0e877 P 9b7ee9648e08408fbd345ce2e184c38a: Deleting consensus metadata
I20260811 12:39:56.379945 3503 ts_tablet_manager.cc:1918] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 12:39:56.380149 3503 log.cc:1196] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/e48cc3b30e2b401ea88e3a59c2f0e877
I20260811 12:39:56.380584 3503 ts_tablet_manager.cc:1939] T e48cc3b30e2b401ea88e3a59c2f0e877 P 3bc7d8e6d604438180c7c23c26351626: Deleting consensus metadata
I20260811 12:39:56.381174 2749 catalog_manager.cc:4841] TS 9b7ee9648e08408fbd345ce2e184c38a (127.0.186.65:40423): tablet e48cc3b30e2b401ea88e3a59c2f0e877 (table test-table [id=8928efb7f36e41dabf9c6d7ac085d562]) successfully deleted
I20260811 12:39:56.381903 2749 catalog_manager.cc:4841] TS 3bc7d8e6d604438180c7c23c26351626 (127.0.186.67:45599): tablet e48cc3b30e2b401ea88e3a59c2f0e877 (table test-table [id=8928efb7f36e41dabf9c6d7ac085d562]) successfully deleted
Aug 11 12:39:56 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:39:56.400300 3504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:56.364161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.0.186.65:40423)
0811 12:39:56.375865 (+ 11704us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:56.375874 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:56.375921 (+ 47us) server_negotiation.cc:407] Connection header received
0811 12:39:56.376001 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:56.376009 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:56.376123 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:56.376290 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:56.379241 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:56.380916 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:56.382668 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:56.383189 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:56.383330 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:56.393854 (+ 10524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:56.393874 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:56.393892 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:56.393939 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:56.397268 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:56.398056 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:56.398065 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:56.398067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:56.398204 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:56.398627 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:56.398630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:56.398632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:56.399003 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:56.399315 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:56.399688 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 12:39:56.399950 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11515,"thread_start_us":11348,"threads_started":1}
W20260811 12:39:56.401074 3004 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37530
W20260811 12:39:56.401831 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2852: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:39:56.402064 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 2852
I20260811 12:39:56.428798 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3013
Aug 11 12:39:56 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:39:56.445363 3506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:56.429580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35024 (local address 127.0.186.66:35439)
0811 12:39:56.430170 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:56.430174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:56.430191 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:39:56.430247 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:56.430250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:56.430310 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:56.430412 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:56.431660 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:56.432390 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:56.433681 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:56.434073 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:56.434186 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:56.438618 (+ 4432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:56.438647 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:56.438665 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:56.438705 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:56.442203 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:56.442992 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:56.443001 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:56.443003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:56.443151 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:56.443531 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:56.443536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:56.443538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:56.443986 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:56.444257 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:56.444482 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 12:39:56.444674 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":306,"threads_started":1}
W20260811 12:39:56.446198 3162 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35024
W20260811 12:39:56.446986 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3013: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:39:56.447171 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 3013
I20260811 12:39:56.480535 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3171
Aug 11 12:39:56 dist-test-slave-qg60 krb5kdc[2716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:39:56.497519 3507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:56.481564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44306 (local address 127.0.186.67:45599)
0811 12:39:56.482157 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:56.482161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:56.482178 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:39:56.482236 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:56.482240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:56.482301 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:56.482397 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:56.483897 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:56.484683 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:56.486015 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:56.486430 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:56.486527 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:56.491132 (+ 4605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:56.491153 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:56.491171 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:56.491214 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:56.494626 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:56.495449 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:56.495457 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:56.495460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:56.495605 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:56.495973 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:56.495977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:56.495979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:56.496378 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:56.496618 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:56.497016 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 12:39:56.497239 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":307,"threads_started":1}
W20260811 12:39:56.498350 3317 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44306
W20260811 12:39:56.498986 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3171: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:39:56.499197 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 3171
I20260811 12:39:56.529868 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 2730
I20260811 12:39:56.531158 2815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:39:56.654986 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 2730
2026-08-11T12:39:56Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8557 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:39:56 dist-test-slave-qg60 krb5kdc[3512](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:39:56 dist-test-slave-qg60 krb5kdc[3512](info): set up 2 sockets
Aug 11 12:39:56 dist-test-slave-qg60 krb5kdc[3512](info): commencing operation
krb5kdc: starting...
W20260811 12:39:57.877588 745 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:39:58 dist-test-slave-qg60 krb5kdc[3512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:39:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:39:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:39:58.137096 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42531
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:42531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:58.492882 3528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:58.493242 3528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:58.493456 3528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:58.501761 3528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:39:58.501907 3528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:58.501956 3528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:58.502041 3528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:39:58.502120 3528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:39:58.512894 3528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:42531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:58.514344 3528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:58.515753 3528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:58.529346 3534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:58.529343 3537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:58.529337 3533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:58.530660 3528 server_base.cc:1034] running on GCE node
I20260811 12:39:58.531602 3528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:58.533372 3528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:58.534624 3528 hybrid_clock.cc:648] HybridClock initialized: now 1786451998534583 us; error 34 us; skew 500 ppm
I20260811 12:39:58.535007 3528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:58 dist-test-slave-qg60 krb5kdc[3512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451998, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:58.538362 3528 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:39:58.539994 3528 webserver.cc:460] Webserver started at http://127.0.186.126:40677/ using document root <none> and password file <none>
I20260811 12:39:58.540794 3528 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:58.540962 3528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:58.541323 3528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:58.544591 3528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "28002342fe1c4f1b967491bea381f55c"
format_stamp: "Formatted at 2026-08-11 12:39:58 on dist-test-slave-qg60"
server_key: "ab3fc21cd32d2a78bf286325e5bfb538"
server_key_iv: "bc9ee92c1d5069f49e4a32fa15c746f8"
server_key_version: "encryptionkey@0"
I20260811 12:39:58.545550 3528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "28002342fe1c4f1b967491bea381f55c"
format_stamp: "Formatted at 2026-08-11 12:39:58 on dist-test-slave-qg60"
server_key: "ab3fc21cd32d2a78bf286325e5bfb538"
server_key_iv: "bc9ee92c1d5069f49e4a32fa15c746f8"
server_key_version: "encryptionkey@0"
I20260811 12:39:58.551172 3528 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:39:58.555290 3545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:58.556851 3528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:39:58.557056 3528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "28002342fe1c4f1b967491bea381f55c"
format_stamp: "Formatted at 2026-08-11 12:39:58 on dist-test-slave-qg60"
server_key: "ab3fc21cd32d2a78bf286325e5bfb538"
server_key_iv: "bc9ee92c1d5069f49e4a32fa15c746f8"
server_key_version: "encryptionkey@0"
I20260811 12:39:58.557291 3528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:58.574971 3528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:58.579581 3528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:58.579903 3528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:58.601163 3528 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:42531
I20260811 12:39:58.601182 3603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:42531 every 8 connection(s)
I20260811 12:39:58.602665 3528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:39:58.603545 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 3528
I20260811 12:39:58.603878 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:39:58.604673 745 external_mini_cluster.cc:1428] Setting key 8115e836f90700529502490fcf959f12
I20260811 12:39:58.607481 3604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:39:58 dist-test-slave-qg60 krb5kdc[3512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:58.619165 3604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c: Bootstrap starting.
I20260811 12:39:58.623958 3604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c: Neither blocks nor log segments found. Creating new log.
I20260811 12:39:58.625521 3604 log.cc:824] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c: Log is configured to *not* fsync() on all Append() calls
I20260811 12:39:58.629484 3604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c: No bootstrap required, opened a new log
I20260811 12:39:58.630416 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:58.606863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33812 (local address 127.0.186.126:42531)
0811 12:39:58.607773 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:58.607785 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:58.607831 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:39:58.609622 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:58.609655 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:58.610050 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:58.610473 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:58.612069 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:58.613522 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:58.614864 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:58.615601 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:58.615815 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:58.620367 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:58.620381 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:58.620401 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:58.620457 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:58.625134 (+ 4677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:58.626400 (+ 1266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:58.626411 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:58.626420 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:58.626703 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:58.627175 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:58.627180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:58.627183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:58.627780 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:58.628025 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:58.628608 (+ 583us) server_negotiation.cc:299] Negotiation successful
0811 12:39:58.629217 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":362,"threads_started":1}
I20260811 12:39:58.637485 3604 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28002342fe1c4f1b967491bea381f55c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42531 } }
I20260811 12:39:58.637902 3604 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:39:58.638015 3604 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28002342fe1c4f1b967491bea381f55c, State: Initialized, Role: FOLLOWER
I20260811 12:39:58.638593 3604 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28002342fe1c4f1b967491bea381f55c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42531 } }
I20260811 12:39:58.638854 3604 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:39:58.639021 3604 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:39:58.639211 3604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:39:58.641764 3604 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28002342fe1c4f1b967491bea381f55c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42531 } }
I20260811 12:39:58.642328 3604 leader_election.cc:302] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28002342fe1c4f1b967491bea381f55c; no voters:
I20260811 12:39:58.642973 3604 leader_election.cc:288] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:39:58.643174 3610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:39:58.643926 3610 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [term 1 LEADER]: Becoming Leader. State: Replica: 28002342fe1c4f1b967491bea381f55c, State: Running, Role: LEADER
I20260811 12:39:58.644559 3610 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28002342fe1c4f1b967491bea381f55c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42531 } }
I20260811 12:39:58.645335 3604 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:39:58.647711 3613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28002342fe1c4f1b967491bea381f55c. Latest consensus state: current_term: 1 leader_uuid: "28002342fe1c4f1b967491bea381f55c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28002342fe1c4f1b967491bea381f55c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42531 } } }
I20260811 12:39:58.648185 3613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:58.648849 3611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28002342fe1c4f1b967491bea381f55c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28002342fe1c4f1b967491bea381f55c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42531 } } }
I20260811 12:39:58.649256 3611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c [sys.catalog]: This master's current role is: LEADER
I20260811 12:39:58.651146 3623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:39:58.657038 3623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:39:58.669680 3623 catalog_manager.cc:1347] Generated new cluster ID: 6819bc5ad21e46d590bd716b94fb3cbe
I20260811 12:39:58.669829 3623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:39:58.704913 3623 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:39:58.707170 3623 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:39:58.726468 3623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28002342fe1c4f1b967491bea381f55c: Generated new TSK 0
I20260811 12:39:58.727627 3623 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:39:58.806218 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42531
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:59.168655 3637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:59.169109 3637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:59.169291 3637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:59.176987 3637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:59.177177 3637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:59.177368 3637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:39:59.187798 3637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:59.189831 3637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:59.191324 3637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:59.206647 3644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:59.206763 3646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:59.207311 3643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:59.207712 3637 server_base.cc:1034] running on GCE node
I20260811 12:39:59.208432 3637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:59.209606 3637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:59.210829 3637 hybrid_clock.cc:648] HybridClock initialized: now 1786451999210771 us; error 43 us; skew 500 ppm
I20260811 12:39:59.211247 3637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:59 dist-test-slave-qg60 krb5kdc[3512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451999, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:59.214617 3637 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:39:59.216310 3637 webserver.cc:460] Webserver started at http://127.0.186.65:43355/ using document root <none> and password file <none>
I20260811 12:39:59.217142 3637 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:59.217300 3637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:59.217640 3637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:59.220788 3637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "a44204ac0eaf49e4ac06a3f21b5284e0"
format_stamp: "Formatted at 2026-08-11 12:39:59 on dist-test-slave-qg60"
server_key: "5b5201bb1e9c1234a0c829cabb980fe4"
server_key_iv: "e917933d54afd6eade58ab016f5cb6d4"
server_key_version: "encryptionkey@0"
I20260811 12:39:59.221681 3637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "a44204ac0eaf49e4ac06a3f21b5284e0"
format_stamp: "Formatted at 2026-08-11 12:39:59 on dist-test-slave-qg60"
server_key: "5b5201bb1e9c1234a0c829cabb980fe4"
server_key_iv: "e917933d54afd6eade58ab016f5cb6d4"
server_key_version: "encryptionkey@0"
I20260811 12:39:59.227592 3637 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s
I20260811 12:39:59.231614 3655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:59.233321 3637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:39:59.233541 3637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "a44204ac0eaf49e4ac06a3f21b5284e0"
format_stamp: "Formatted at 2026-08-11 12:39:59 on dist-test-slave-qg60"
server_key: "5b5201bb1e9c1234a0c829cabb980fe4"
server_key_iv: "e917933d54afd6eade58ab016f5cb6d4"
server_key_version: "encryptionkey@0"
I20260811 12:39:59.233807 3637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:59.256433 3637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:59.261304 3637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:59.261664 3637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:59.262893 3637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:59.264477 3637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:59.264559 3637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:59.264767 3637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:59.264839 3637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 12:39:59.302040 3637 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:46467
I20260811 12:39:59.302147 3792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:46467 every 8 connection(s)
I20260811 12:39:59.303449 3637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:39:59.313477 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 3637
I20260811 12:39:59.313741 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:39:59.314577 745 external_mini_cluster.cc:1428] Setting key 71782b9134b6381e8ae203e091b225ce
Aug 11 12:39:59 dist-test-slave-qg60 krb5kdc[3512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451999, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:59.328791 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:59.306494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:42565 (local address 127.0.186.126:42531)
0811 12:39:59.307031 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:59.307039 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:59.308134 (+ 1095us) server_negotiation.cc:407] Connection header received
0811 12:39:59.310177 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:59.310181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:59.310257 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:59.310364 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:59.312075 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.312939 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.315537 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.316105 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.316227 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:59.320853 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:59.320863 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:59.320871 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:59.320924 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:59.324908 (+ 3984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:59.325879 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:59.325888 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:59.325894 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:59.326061 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:59.326686 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:59.326690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:59.326692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:59.326992 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:59.327113 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:59.328255 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0811 12:39:59.328448 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":253,"threads_started":1}
I20260811 12:39:59.330610 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:59.307143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:42531 (local address 127.0.186.65:42565)
0811 12:39:59.307952 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:59.308000 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:59.309870 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:59.310617 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:59.310644 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:59.311258 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:59.311867 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:59.311885 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.313150 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.313158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:59.315324 (+ 2166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:59.315348 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.316384 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.316392 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:59.316705 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:59.317537 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:59.317581 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:59.320545 (+ 2964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:59.325105 (+ 4560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:59.325114 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:59.325131 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:59.325729 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:59.326197 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:59.326201 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:59.326204 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:59.326544 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:59.327140 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:59.327151 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:59.327729 (+ 578us) client_negotiation.cc:769] Sending connection context
0811 12:39:59.328152 (+ 423us) client_negotiation.cc:240] Negotiation successful
0811 12:39:59.328905 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":310,"threads_started":1}
I20260811 12:39:59.332463 3793 heartbeater.cc:347] Connected to a master server at 127.0.186.126:42531
I20260811 12:39:59.332886 3793 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:59.333755 3793 heartbeater.cc:511] Master 127.0.186.126:42531 requested a full tablet report, sending...
I20260811 12:39:59.336253 3564 ts_manager.cc:194] Registered new tserver with Master: a44204ac0eaf49e4ac06a3f21b5284e0 (127.0.186.65:46467)
I20260811 12:39:59.337957 3564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:42565
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:39:59.377550 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42531
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:39:59.742314 3800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:39:59.742681 3800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:39:59.742792 3800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:39:59.750545 3800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:39:59.750676 3800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:39:59.750797 3800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:39:59.761065 3800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:39:59.762639 3800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:39:59.764078 3800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:39:59.778600 3808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:59.778633 3810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:39:59.778518 3805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:39:59.779623 3800 server_base.cc:1034] running on GCE node
I20260811 12:39:59.780277 3800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:39:59.781399 3800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:39:59.782645 3800 hybrid_clock.cc:648] HybridClock initialized: now 1786451999782572 us; error 69 us; skew 500 ppm
I20260811 12:39:59.782989 3800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:39:59 dist-test-slave-qg60 krb5kdc[3512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451999, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:39:59.786334 3800 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:39:59.787918 3800 webserver.cc:460] Webserver started at http://127.0.186.66:36101/ using document root <none> and password file <none>
I20260811 12:39:59.788655 3800 fs_manager.cc:359] Metadata directory not provided
I20260811 12:39:59.788832 3800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:39:59.789186 3800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:39:59.792398 3800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "9e1fc92bc7aa459ebe300d59bd33a637"
format_stamp: "Formatted at 2026-08-11 12:39:59 on dist-test-slave-qg60"
server_key: "fd73cde566dfdd74c68ecbc2065109b5"
server_key_iv: "2d7e5bdc1b01b81c90d3eda6594ff069"
server_key_version: "encryptionkey@0"
I20260811 12:39:59.793269 3800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "9e1fc92bc7aa459ebe300d59bd33a637"
format_stamp: "Formatted at 2026-08-11 12:39:59 on dist-test-slave-qg60"
server_key: "fd73cde566dfdd74c68ecbc2065109b5"
server_key_iv: "2d7e5bdc1b01b81c90d3eda6594ff069"
server_key_version: "encryptionkey@0"
I20260811 12:39:59.798818 3800 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:39:59.802701 3819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:59.804171 3800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:39:59.804379 3800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "9e1fc92bc7aa459ebe300d59bd33a637"
format_stamp: "Formatted at 2026-08-11 12:39:59 on dist-test-slave-qg60"
server_key: "fd73cde566dfdd74c68ecbc2065109b5"
server_key_iv: "2d7e5bdc1b01b81c90d3eda6594ff069"
server_key_version: "encryptionkey@0"
I20260811 12:39:59.804625 3800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:39:59.825860 3800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:39:59.830403 3800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:39:59.830750 3800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:39:59.831907 3800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:39:59.833544 3800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:39:59.833652 3800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:59.833808 3800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:39:59.833880 3800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:39:59.870121 3800 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:35065
I20260811 12:39:59.870175 3946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:35065 every 8 connection(s)
I20260811 12:39:59.871546 3800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:39:59.873975 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 3800
I20260811 12:39:59.874197 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:39:59.874805 745 external_mini_cluster.cc:1428] Setting key d759e7cf4cf5f75eeca4e1e82c7b239f
Aug 11 12:39:59 dist-test-slave-qg60 krb5kdc[3512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786451999, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:39:59.895763 3949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:59.874422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:37941 (local address 127.0.186.126:42531)
0811 12:39:59.874945 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0811 12:39:59.874951 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:39:59.876172 (+ 1221us) server_negotiation.cc:407] Connection header received
0811 12:39:59.878216 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:39:59.878224 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:39:59.878319 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:39:59.878447 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:39:59.880074 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.881300 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.882917 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.883714 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.883865 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:59.888049 (+ 4184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:39:59.888059 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:39:59.888066 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:39:59.888118 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:39:59.891959 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:59.892881 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:59.892889 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:59.892895 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:59.893080 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:39:59.893544 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:39:59.893552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:39:59.893558 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:39:59.894006 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:39:59.894189 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 12:39:59.894949 (+ 760us) server_negotiation.cc:299] Negotiation successful
0811 12:39:59.895238 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":259,"threads_started":1}
I20260811 12:39:59.896535 3951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:39:59.875127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:42531 (local address 127.0.186.66:37941)
0811 12:39:59.875988 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 12:39:59.876046 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 12:39:59.877929 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:39:59.878698 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:39:59.878706 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:39:59.879278 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:39:59.879885 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:59.879903 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.881460 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.881464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:59.882758 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:39:59.882771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:39:59.883951 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:39:59.883955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:39:59.884189 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:39:59.884965 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:39:59.884996 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:39:59.887757 (+ 2761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:39:59.892145 (+ 4388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:59.892155 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:59.892171 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:59.892687 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:59.893198 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:39:59.893202 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:39:59.893205 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:39:59.893411 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:39:59.894164 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:39:59.894170 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:39:59.894531 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 12:39:59.894792 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 12:39:59.895222 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":371,"threads_started":1}
I20260811 12:39:59.898298 3947 heartbeater.cc:347] Connected to a master server at 127.0.186.126:42531
I20260811 12:39:59.898646 3947 heartbeater.cc:464] Registering TS with master...
I20260811 12:39:59.899425 3947 heartbeater.cc:511] Master 127.0.186.126:42531 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
I20260811 12:39:59.901096 3564 ts_manager.cc:194] Registered new tserver with Master: 9e1fc92bc7aa459ebe300d59bd33a637 (127.0.186.66:35065)
I20260811 12:39:59.901969 3564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:37941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:39:59.936321 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42531
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:00.290969 3954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:00.291360 3954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:00.291544 3954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:00.299324 3954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:00.299530 3954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:00.299726 3954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:00.310719 3954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:42531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:00.312103 3954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:00.313591 3954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:00.328295 3959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:00.328277 3960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:00.328208 3963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:00.329656 3954 server_base.cc:1034] running on GCE node
I20260811 12:40:00.330547 3954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:00.331704 3954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:00.333083 3954 hybrid_clock.cc:648] HybridClock initialized: now 1786452000332899 us; error 80 us; skew 500 ppm
I20260811 12:40:00.333550 3954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:00 dist-test-slave-qg60 krb5kdc[3512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452000, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:00.337801 3954 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:40:00.339624 3954 webserver.cc:460] Webserver started at http://127.0.186.67:39751/ using document root <none> and password file <none>
I20260811 12:40:00.340400 3954 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:00.340554 3954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:00.340932 3954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:00.341547 3793 heartbeater.cc:503] Master 127.0.186.126:42531 was elected leader, sending a full tablet report...
I20260811 12:40:00.345106 3954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "bb26423f6d64457a8459c3c3758768af"
format_stamp: "Formatted at 2026-08-11 12:40:00 on dist-test-slave-qg60"
server_key: "f0ff53319f5a8fb5692742b0327c6dc2"
server_key_iv: "1a3ed48ddbd1a6c1f045f4149fe329e1"
server_key_version: "encryptionkey@0"
I20260811 12:40:00.346064 3954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "bb26423f6d64457a8459c3c3758768af"
format_stamp: "Formatted at 2026-08-11 12:40:00 on dist-test-slave-qg60"
server_key: "f0ff53319f5a8fb5692742b0327c6dc2"
server_key_iv: "1a3ed48ddbd1a6c1f045f4149fe329e1"
server_key_version: "encryptionkey@0"
I20260811 12:40:00.352195 3954 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 12:40:00.356598 3972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:00.358383 3954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:00.358553 3954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "bb26423f6d64457a8459c3c3758768af"
format_stamp: "Formatted at 2026-08-11 12:40:00 on dist-test-slave-qg60"
server_key: "f0ff53319f5a8fb5692742b0327c6dc2"
server_key_iv: "1a3ed48ddbd1a6c1f045f4149fe329e1"
server_key_version: "encryptionkey@0"
I20260811 12:40:00.358851 3954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:00.378765 3954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:00.383692 3954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:00.384047 3954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:00.385289 3954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:00.386824 3954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:00.386904 3954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:00.387048 3954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:00.387118 3954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:00.425388 3954 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:43733
I20260811 12:40:00.425468 4097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:43733 every 8 connection(s)
I20260811 12:40:00.426782 3954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:00.432714 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 3954
I20260811 12:40:00.432966 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:00.433542 745 external_mini_cluster.cc:1428] Setting key dad5791bb570a59f430d689a185647e8
Aug 11 12:40:00 dist-test-slave-qg60 krb5kdc[3512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452000, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:00.451344 4101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:00.429991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44417 (local address 127.0.186.126:42531)
0811 12:40:00.430563 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:00.430567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:00.431648 (+ 1081us) server_negotiation.cc:407] Connection header received
0811 12:40:00.434319 (+ 2671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:00.434326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:00.434425 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:00.434558 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:00.436411 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:00.437499 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:00.439274 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:00.439701 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:00.439846 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:00.443923 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:00.443928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:00.443932 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:00.443970 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:00.447196 (+ 3226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:00.448204 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:00.448209 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:00.448211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:00.448416 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:00.449038 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:00.449042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:00.449045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:00.449477 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:00.449690 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:00.450806 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0811 12:40:00.451044 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":286,"threads_started":1}
I20260811 12:40:00.452422 4102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:00.430608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:42531 (local address 127.0.186.67:44417)
0811 12:40:00.431416 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:00.431493 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:00.433978 (+ 2485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:00.434839 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:00.434848 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:00.435610 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:00.436229 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:00.436247 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:00.437756 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:00.437760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:00.439122 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:00.439136 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:00.439969 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:00.439979 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:00.440239 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:00.441089 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:00.441126 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:00.443645 (+ 2519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:00.447368 (+ 3723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:00.447379 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:00.447398 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:00.448063 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:00.448562 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:00.448566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:00.448568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:00.448848 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:00.449670 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:00.449680 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:00.450238 (+ 558us) client_negotiation.cc:769] Sending connection context
0811 12:40:00.450638 (+ 400us) client_negotiation.cc:240] Negotiation successful
0811 12:40:00.451212 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":314,"threads_started":1}
I20260811 12:40:00.454305 4099 heartbeater.cc:347] Connected to a master server at 127.0.186.126:42531
I20260811 12:40:00.454625 4099 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:00.455443 4099 heartbeater.cc:511] Master 127.0.186.126:42531 requested a full tablet report, sending...
I20260811 12:40:00.457278 3564 ts_manager.cc:194] Registered new tserver with Master: bb26423f6d64457a8459c3c3758768af (127.0.186.67:43733)
I20260811 12:40:00.458218 3564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:44417
I20260811 12:40:00.463317 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 12:40:00.512931 4101 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:00.509490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33822 (local address 127.0.186.126:42531)
0811 12:40:00.509791 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:00.509800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:00.510453 (+ 653us) server_negotiation.cc:407] Connection header received
0811 12:40:00.510699 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:00.510705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:00.510801 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:00.510942 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:00.512517 (+ 1575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33822: BlockingRecv error: recv got EOF from 127.0.0.1:33822 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 12:40:00.516893 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3637
W20260811 12:40:00.520813 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3637: Not authorized: Client connection negotiation failed: client connection to 127.0.186.65:46467: server requires authentication, but client does not have Kerberos credentials available
I20260811 12:40:00.521031 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 3637
I20260811 12:40:00.543876 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3800
W20260811 12:40:00.547087 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3800: Not authorized: Client connection negotiation failed: client connection to 127.0.186.66:35065: server requires authentication, but client does not have Kerberos credentials available
I20260811 12:40:00.547286 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 3800
I20260811 12:40:00.569609 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3954
W20260811 12:40:00.573272 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3954: Not authorized: Client connection negotiation failed: client connection to 127.0.186.67:43733: server requires authentication, but client does not have Kerberos credentials available
I20260811 12:40:00.573410 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 3954
I20260811 12:40:00.596433 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 3528
I20260811 12:40:00.597958 3598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:00.711822 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 3528
2026-08-11T12:40:00Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4052 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:00 dist-test-slave-qg60 krb5kdc[4120](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:00 dist-test-slave-qg60 krb5kdc[4120](info): set up 2 sockets
Aug 11 12:40:00 dist-test-slave-qg60 krb5kdc[4120](info): commencing operation
krb5kdc: starting...
W20260811 12:40:01.927642 745 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:02 dist-test-slave-qg60 krb5kdc[4120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:02.194486 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:44719
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:44719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:02.559284 4133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:02.559679 4133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:02.559860 4133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:02.567972 4133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:02.568146 4133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:02.568256 4133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:02.568360 4133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:02.568450 4133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:02.578647 4133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:44719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:44719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:02.580106 4133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:02.581547 4133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:02.594317 4138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:02.594192 4139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:02.594360 4141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:02.595007 4133 server_base.cc:1034] running on GCE node
I20260811 12:40:02.595880 4133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:02.597463 4133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:02.598675 4133 hybrid_clock.cc:648] HybridClock initialized: now 1786452002598573 us; error 99 us; skew 500 ppm
I20260811 12:40:02.599125 4133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:02 dist-test-slave-qg60 krb5kdc[4120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452002, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:02.608785 4133 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:02.610430 4133 webserver.cc:460] Webserver started at http://127.0.186.126:39319/ using document root <none> and password file <none>
I20260811 12:40:02.611202 4133 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:02.611317 4133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:02.611593 4133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:02.614887 4133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212"
format_stamp: "Formatted at 2026-08-11 12:40:02 on dist-test-slave-qg60"
server_key: "d54b79a881135cb6961635ee72d110e3"
server_key_iv: "a031a6cbd0c8f72b003ba16fae2b0eb7"
server_key_version: "encryptionkey@0"
I20260811 12:40:02.615727 4133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212"
format_stamp: "Formatted at 2026-08-11 12:40:02 on dist-test-slave-qg60"
server_key: "d54b79a881135cb6961635ee72d110e3"
server_key_iv: "a031a6cbd0c8f72b003ba16fae2b0eb7"
server_key_version: "encryptionkey@0"
I20260811 12:40:02.621307 4133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 12:40:02.625059 4149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:02.626500 4133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 12:40:02.626693 4133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212"
format_stamp: "Formatted at 2026-08-11 12:40:02 on dist-test-slave-qg60"
server_key: "d54b79a881135cb6961635ee72d110e3"
server_key_iv: "a031a6cbd0c8f72b003ba16fae2b0eb7"
server_key_version: "encryptionkey@0"
I20260811 12:40:02.626901 4133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:02.652645 4133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:02.657099 4133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:02.657363 4133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:02.677850 4133 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:44719
I20260811 12:40:02.677884 4208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:44719 every 8 connection(s)
I20260811 12:40:02.679857 4133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:02.682457 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4133
I20260811 12:40:02.682688 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:02.683561 745 external_mini_cluster.cc:1428] Setting key ff615382ab39769cbc3c1fc458fb3ac9
I20260811 12:40:02.684501 4209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:40:02 dist-test-slave-qg60 krb5kdc[4120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:02.699986 4209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212: Bootstrap starting.
I20260811 12:40:02.703346 4209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:02.704442 4209 log.cc:824] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:02.707688 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:02.685654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45210 (local address 127.0.186.126:44719)
0811 12:40:02.686480 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:02.686492 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:02.686534 (+ 42us) server_negotiation.cc:407] Connection header received
0811 12:40:02.688104 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:02.688125 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:02.688529 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:02.688954 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:02.690922 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:02.692338 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:02.694148 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:02.694851 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:02.694991 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:02.699825 (+ 4834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:02.699835 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:02.699850 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:02.699887 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:02.703025 (+ 3138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:02.703899 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:02.703906 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:02.703912 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:02.704112 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:02.704540 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:02.704544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:02.704546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:02.705256 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:02.705621 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:02.706113 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 12:40:02.706560 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":389,"threads_started":1}
I20260811 12:40:02.707906 4209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212: No bootstrap required, opened a new log
I20260811 12:40:02.711920 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:40:02.716543 4209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44719 } }
I20260811 12:40:02.717052 4209 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:02.717257 4209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f13b20cf0d24bb2b3d5c8e94eee2212, State: Initialized, Role: FOLLOWER
I20260811 12:40:02.717921 4209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44719 } }
I20260811 12:40:02.718209 4209 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:02.718371 4209 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:02.718564 4209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:02.720955 4209 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44719 } }
I20260811 12:40:02.721546 4209 leader_election.cc:302] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f13b20cf0d24bb2b3d5c8e94eee2212; no voters:
I20260811 12:40:02.722364 4209 leader_election.cc:288] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:02.722620 4215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:02.724082 4215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [term 1 LEADER]: Becoming Leader. State: Replica: 1f13b20cf0d24bb2b3d5c8e94eee2212, State: Running, Role: LEADER
I20260811 12:40:02.724694 4215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44719 } }
I20260811 12:40:02.724869 4209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:02.727418 4217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f13b20cf0d24bb2b3d5c8e94eee2212. Latest consensus state: current_term: 1 leader_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44719 } } }
I20260811 12:40:02.727838 4217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:02.728392 4216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f13b20cf0d24bb2b3d5c8e94eee2212" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44719 } } }
I20260811 12:40:02.728718 4216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:02.737428 4222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:02.744822 4222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:02.766345 4222 catalog_manager.cc:1347] Generated new cluster ID: b0fa4a1586184fb98b5f40cd91d01ab3
I20260811 12:40:02.766505 4222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:02.802052 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:02.792111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45224 (local address 127.0.186.126:44719)
0811 12:40:02.792325 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:02.792331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:02.792946 (+ 615us) server_negotiation.cc:407] Connection header received
0811 12:40:02.793170 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:02.793176 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:02.793261 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:02.793373 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:02.794745 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:02.795921 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:02.797912 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:02.798561 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:02.798701 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:02.800125 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:02.800135 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:02.800140 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:02.801098 (+ 958us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:02.801163 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:02.801213 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:02.801339 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:02.801532 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 12:40:02.801641 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 12:40:02.805445 4222 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:02.807379 4222 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:02.822877 4222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f13b20cf0d24bb2b3d5c8e94eee2212: Generated new TSK 0
I20260811 12:40:02.824013 4222 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:40:02.839159 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4133
I20260811 12:40:02.841485 4204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:02.937558 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4133
2026-08-11T12:40:02Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2221 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:03 dist-test-slave-qg60 krb5kdc[4251](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:03 dist-test-slave-qg60 krb5kdc[4251](info): set up 2 sockets
Aug 11 12:40:03 dist-test-slave-qg60 krb5kdc[4251](info): commencing operation
krb5kdc: starting...
W20260811 12:40:04.150383 745 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.005s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:04 dist-test-slave-qg60 krb5kdc[4251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:04.413228 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35563
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:04.768105 4266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:04.768450 4266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:04.768639 4266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:04.776341 4266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:04.776468 4266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:04.776611 4266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:04.776710 4266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:04.776806 4266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:04.787200 4266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:04.788674 4266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:04.790164 4266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:04.803109 4271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:04.803269 4272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:04.803325 4274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:04.803977 4266 server_base.cc:1034] running on GCE node
I20260811 12:40:04.804998 4266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:04.806620 4266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:04.807859 4266 hybrid_clock.cc:648] HybridClock initialized: now 1786452004807791 us; error 50 us; skew 500 ppm
I20260811 12:40:04.808276 4266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:04 dist-test-slave-qg60 krb5kdc[4251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452004, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:04.811753 4266 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:04.813511 4266 webserver.cc:460] Webserver started at http://127.0.186.126:38641/ using document root <none> and password file <none>
I20260811 12:40:04.814250 4266 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:04.814415 4266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:04.814749 4266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:04.818377 4266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "10236a3ab54f48439cc039b633cc21ed"
format_stamp: "Formatted at 2026-08-11 12:40:04 on dist-test-slave-qg60"
server_key: "d8bdfebdaa229f5fea386cf090759d03"
server_key_iv: "240a98c691d208f40bf414e9f0877a60"
server_key_version: "encryptionkey@0"
I20260811 12:40:04.819233 4266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "10236a3ab54f48439cc039b633cc21ed"
format_stamp: "Formatted at 2026-08-11 12:40:04 on dist-test-slave-qg60"
server_key: "d8bdfebdaa229f5fea386cf090759d03"
server_key_iv: "240a98c691d208f40bf414e9f0877a60"
server_key_version: "encryptionkey@0"
I20260811 12:40:04.825099 4266 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 12:40:04.829262 4281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:04.830832 4266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:40:04.831091 4266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "10236a3ab54f48439cc039b633cc21ed"
format_stamp: "Formatted at 2026-08-11 12:40:04 on dist-test-slave-qg60"
server_key: "d8bdfebdaa229f5fea386cf090759d03"
server_key_iv: "240a98c691d208f40bf414e9f0877a60"
server_key_version: "encryptionkey@0"
I20260811 12:40:04.831334 4266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:04.860997 4266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:04.866050 4266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:04.866377 4266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:04.887413 4266 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35563
I20260811 12:40:04.887449 4339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35563 every 8 connection(s)
I20260811 12:40:04.889150 4266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:04.893246 4340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:04.899245 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4266
I20260811 12:40:04.899500 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:04.900362 745 external_mini_cluster.cc:1428] Setting key f297d4978008b575c01246daba5fb729
I20260811 12:40:04.905686 4340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed: Bootstrap starting.
I20260811 12:40:04.909668 4340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:04.911051 4340 log.cc:824] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:04.915303 4340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed: No bootstrap required, opened a new log
Aug 11 12:40:04 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:04.926796 4340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10236a3ab54f48439cc039b633cc21ed" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35563 } }
I20260811 12:40:04.927299 4340 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:04.927435 4340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10236a3ab54f48439cc039b633cc21ed, State: Initialized, Role: FOLLOWER
I20260811 12:40:04.927964 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:04.902750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52532 (local address 127.0.186.126:35563)
0811 12:40:04.903742 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:04.903755 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:04.903798 (+ 43us) server_negotiation.cc:407] Connection header received
0811 12:40:04.905564 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:04.905586 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:04.906053 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:04.906379 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:04.908295 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:04.909743 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:04.911665 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:04.912897 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:04.913046 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:04.918127 (+ 5081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:04.918144 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:04.918166 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:04.918223 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:04.922715 (+ 4492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:04.923513 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:04.923523 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:04.923533 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:04.923765 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:04.924221 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:04.924228 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:04.924231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:04.925136 (+ 905us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:04.925490 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:04.925920 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 12:40:04.926432 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":495,"threads_started":1}
I20260811 12:40:04.928172 4340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10236a3ab54f48439cc039b633cc21ed" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35563 } }
I20260811 12:40:04.928507 4340 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:04.928675 4340 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:04.928925 4340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:04.931428 4340 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10236a3ab54f48439cc039b633cc21ed" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35563 } }
I20260811 12:40:04.931970 4340 leader_election.cc:302] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10236a3ab54f48439cc039b633cc21ed; no voters:
I20260811 12:40:04.932632 4340 leader_election.cc:288] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:04.932828 4345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:04.933585 4345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [term 1 LEADER]: Becoming Leader. State: Replica: 10236a3ab54f48439cc039b633cc21ed, State: Running, Role: LEADER
I20260811 12:40:04.934232 4345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10236a3ab54f48439cc039b633cc21ed" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35563 } }
I20260811 12:40:04.934919 4340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:04.937371 4346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10236a3ab54f48439cc039b633cc21ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10236a3ab54f48439cc039b633cc21ed" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35563 } } }
I20260811 12:40:04.937886 4346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:04.937326 4347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10236a3ab54f48439cc039b633cc21ed. Latest consensus state: current_term: 1 leader_uuid: "10236a3ab54f48439cc039b633cc21ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10236a3ab54f48439cc039b633cc21ed" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35563 } } }
I20260811 12:40:04.938395 4347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:04.946121 4351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:04.951925 4351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:04.961618 4351 catalog_manager.cc:1347] Generated new cluster ID: 6f5921fc1c254ed9885594d4ccbe8868
I20260811 12:40:04.961763 4351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:04.980692 4351 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:04.982273 4351 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:04.992194 4351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10236a3ab54f48439cc039b633cc21ed: Generated new TSK 0
I20260811 12:40:04.993283 4351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:40:05.073623 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35563
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:05.442667 4370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:05.442970 4370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:05.443069 4370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:05.450742 4370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:05.450881 4370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:05.451061 4370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:05.461755 4370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35563
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:05.463248 4370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:05.464699 4370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:05.478730 4377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:05.479174 4376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:05.479230 4379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:05.479696 4370 server_base.cc:1034] running on GCE node
I20260811 12:40:05.480443 4370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:05.481629 4370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:05.482880 4370 hybrid_clock.cc:648] HybridClock initialized: now 1786452005482825 us; error 51 us; skew 500 ppm
I20260811 12:40:05.483197 4370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:05 dist-test-slave-qg60 krb5kdc[4251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452005, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:05.486825 4370 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:40:05.488715 4370 webserver.cc:460] Webserver started at http://127.0.186.65:34711/ using document root <none> and password file <none>
I20260811 12:40:05.489595 4370 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:05.489710 4370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:05.489991 4370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:05.493424 4370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "96d9aa94facb4fa294cd44562403e7aa"
format_stamp: "Formatted at 2026-08-11 12:40:05 on dist-test-slave-qg60"
server_key: "e872cc247b585662059cb80c0727d8cc"
server_key_iv: "1bca1f07ebfc76b4df1b4521d01ac2af"
server_key_version: "encryptionkey@0"
I20260811 12:40:05.494302 4370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "96d9aa94facb4fa294cd44562403e7aa"
format_stamp: "Formatted at 2026-08-11 12:40:05 on dist-test-slave-qg60"
server_key: "e872cc247b585662059cb80c0727d8cc"
server_key_iv: "1bca1f07ebfc76b4df1b4521d01ac2af"
server_key_version: "encryptionkey@0"
I20260811 12:40:05.500500 4370 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 12:40:05.504446 4387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:05.506138 4370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:05.506294 4370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "96d9aa94facb4fa294cd44562403e7aa"
format_stamp: "Formatted at 2026-08-11 12:40:05 on dist-test-slave-qg60"
server_key: "e872cc247b585662059cb80c0727d8cc"
server_key_iv: "1bca1f07ebfc76b4df1b4521d01ac2af"
server_key_version: "encryptionkey@0"
I20260811 12:40:05.506479 4370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:05.535710 4370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:05.540233 4370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:05.540498 4370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:05.541627 4370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:05.543187 4370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:05.543263 4370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:05.543349 4370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:05.543394 4370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:05.580391 4370 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:35637
I20260811 12:40:05.580488 4523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:35637 every 8 connection(s)
I20260811 12:40:05.581820 4370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:05.584192 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4370
I20260811 12:40:05.584434 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:05.585341 745 external_mini_cluster.cc:1428] Setting key c258e60e51727c482fb692262d0df2e6
Aug 11 12:40:05 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452005, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:05.605273 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:05.584834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:45193 (local address 127.0.186.126:35563)
0811 12:40:05.585438 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:05.585444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:05.586685 (+ 1241us) server_negotiation.cc:407] Connection header received
0811 12:40:05.588838 (+ 2153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:05.588844 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:05.588955 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:05.589076 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:05.590682 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:05.591439 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:05.593155 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:05.593563 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:05.593718 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:05.598096 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:05.598105 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:05.598115 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:05.598167 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:05.601150 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:05.602240 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:05.602245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:05.602247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:05.602383 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:05.602957 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:05.602960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:05.602962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:05.603310 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:05.603428 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:05.604506 (+ 1078us) server_negotiation.cc:299] Negotiation successful
0811 12:40:05.604695 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":345,"threads_started":1}
I20260811 12:40:05.606766 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:05.585407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35563 (local address 127.0.186.65:45193)
0811 12:40:05.586504 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:05.586548 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:05.588512 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:05.589344 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:05.589353 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:05.589901 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:05.590498 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:05.590515 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:05.591621 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:05.591631 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:05.592975 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:05.593000 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:05.593830 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:05.593838 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:05.594089 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:05.594825 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:05.594849 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:05.597731 (+ 2882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:05.601319 (+ 3588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:05.601333 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:05.601355 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:05.602060 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:05.602516 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:05.602523 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:05.602530 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:05.602828 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:05.603453 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:05.603464 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:05.604044 (+ 580us) client_negotiation.cc:769] Sending connection context
0811 12:40:05.604409 (+ 365us) client_negotiation.cc:240] Negotiation successful
0811 12:40:05.605081 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":436,"threads_started":1}
I20260811 12:40:05.608551 4524 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35563
I20260811 12:40:05.608980 4524 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:05.610036 4524 heartbeater.cc:511] Master 127.0.186.126:35563 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
I20260811 12:40:05.612632 4302 ts_manager.cc:194] Registered new tserver with Master: 96d9aa94facb4fa294cd44562403e7aa (127.0.186.65:35637)
I20260811 12:40:05.614207 4302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:45193
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:40:05.644958 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35563
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:05.998396 4530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:05.998709 4530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:05.998816 4530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:06.006753 4530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:06.006928 4530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:06.007114 4530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:06.018083 4530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35563
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:06.019551 4530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:06.021080 4530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:06.035048 4538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:06.035012 4536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:06.034957 4535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:06.036026 4530 server_base.cc:1034] running on GCE node
I20260811 12:40:06.036864 4530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:06.037873 4530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:06.039113 4530 hybrid_clock.cc:648] HybridClock initialized: now 1786452006039061 us; error 71 us; skew 500 ppm
I20260811 12:40:06.039475 4530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:06.043277 4530 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:40:06.044927 4530 webserver.cc:460] Webserver started at http://127.0.186.66:33249/ using document root <none> and password file <none>
I20260811 12:40:06.045622 4530 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:06.045723 4530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:06.045979 4530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:06.049095 4530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "3700b3a1a587496bae700d0cdf1a7ff2"
format_stamp: "Formatted at 2026-08-11 12:40:06 on dist-test-slave-qg60"
server_key: "7d2ee929bef1768fa01cf6ed01cf0915"
server_key_iv: "c6daf45a2881b214e7d6e0386ebf09a5"
server_key_version: "encryptionkey@0"
I20260811 12:40:06.049857 4530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "3700b3a1a587496bae700d0cdf1a7ff2"
format_stamp: "Formatted at 2026-08-11 12:40:06 on dist-test-slave-qg60"
server_key: "7d2ee929bef1768fa01cf6ed01cf0915"
server_key_iv: "c6daf45a2881b214e7d6e0386ebf09a5"
server_key_version: "encryptionkey@0"
I20260811 12:40:06.055140 4530 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:40:06.058609 4547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:06.059968 4530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:40:06.060122 4530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "3700b3a1a587496bae700d0cdf1a7ff2"
format_stamp: "Formatted at 2026-08-11 12:40:06 on dist-test-slave-qg60"
server_key: "7d2ee929bef1768fa01cf6ed01cf0915"
server_key_iv: "c6daf45a2881b214e7d6e0386ebf09a5"
server_key_version: "encryptionkey@0"
I20260811 12:40:06.060288 4530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:06.076141 4530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:06.080668 4530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:06.081086 4530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:06.082163 4530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:06.083679 4530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:06.083755 4530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:06.083906 4530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:06.083961 4530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:06.119335 4530 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:42173
I20260811 12:40:06.119387 4679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:42173 every 8 connection(s)
I20260811 12:40:06.120682 4530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:06.123550 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4530
I20260811 12:40:06.123770 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:06.124229 745 external_mini_cluster.cc:1428] Setting key 5704c30394db5ca58a36dcc72be5233f
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:06.144064 4682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.123468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:40797 (local address 127.0.186.126:35563)
0811 12:40:06.126570 (+ 3102us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:06.126576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:06.126598 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:40:06.127688 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:06.127693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:06.127783 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:06.127901 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:06.129526 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.130262 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.131861 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.132301 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.132443 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.136349 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:06.136359 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:06.136367 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:06.136417 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:06.140298 (+ 3881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.141175 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.141184 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.141191 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.141358 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.141792 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.141800 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.141806 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.142264 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:06.142461 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:06.143185 (+ 724us) server_negotiation.cc:299] Negotiation successful
0811 12:40:06.143444 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2975,"thread_start_us":2860,"threads_started":1}
I20260811 12:40:06.144657 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.124194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35563 (local address 127.0.186.66:40797)
0811 12:40:06.125270 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:06.125332 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:06.127395 (+ 2063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:06.128160 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:06.128169 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:06.128686 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:06.129349 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:06.129368 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.130455 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.130459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:06.131697 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:06.131709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.132544 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.132551 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:06.132852 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.133561 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:06.133584 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:06.136090 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:06.140462 (+ 4372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:06.140472 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:06.140489 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:06.141021 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:06.141469 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:06.141472 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:06.141475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:06.141663 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:06.142423 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:06.142430 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:06.142756 (+ 326us) client_negotiation.cc:769] Sending connection context
0811 12:40:06.143048 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 12:40:06.143491 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":429,"threads_started":1}
I20260811 12:40:06.146225 4680 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35563
I20260811 12:40:06.146634 4680 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:06.147660 4680 heartbeater.cc:511] Master 127.0.186.126:35563 requested a full tablet report, sending...
I20260811 12:40:06.149492 4302 ts_manager.cc:194] Registered new tserver with Master: 3700b3a1a587496bae700d0cdf1a7ff2 (127.0.186.66:42173)
I20260811 12:40:06.150341 4302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:40797
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:40:06.184265 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35563
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:06.557098 4686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:06.557400 4686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:06.557507 4686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:06.565251 4686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:06.565379 4686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:06.565507 4686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:06.575737 4686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35563
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:06.577092 4686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:06.578411 4686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:06.595072 4693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:06.595157 4694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:06.595115 4698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:06.595913 4686 server_base.cc:1034] running on GCE node
I20260811 12:40:06.596592 4686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:06.597651 4686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:06.598917 4686 hybrid_clock.cc:648] HybridClock initialized: now 1786452006598851 us; error 55 us; skew 500 ppm
I20260811 12:40:06.599308 4686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:06.603402 4686 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:40:06.605309 4686 webserver.cc:460] Webserver started at http://127.0.186.67:33455/ using document root <none> and password file <none>
I20260811 12:40:06.606083 4686 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:06.606240 4686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:06.606580 4686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:06.610076 4686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "42efc977a19d46edbc27db41e538d51c"
format_stamp: "Formatted at 2026-08-11 12:40:06 on dist-test-slave-qg60"
server_key: "a992be24d6fa19be0f7a8dc1796d79de"
server_key_iv: "87a36c1a788141e766c58ce91ab00928"
server_key_version: "encryptionkey@0"
I20260811 12:40:06.610960 4686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "42efc977a19d46edbc27db41e538d51c"
format_stamp: "Formatted at 2026-08-11 12:40:06 on dist-test-slave-qg60"
server_key: "a992be24d6fa19be0f7a8dc1796d79de"
server_key_iv: "87a36c1a788141e766c58ce91ab00928"
server_key_version: "encryptionkey@0"
I20260811 12:40:06.616487 4686 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 12:40:06.617594 4524 heartbeater.cc:503] Master 127.0.186.126:35563 was elected leader, sending a full tablet report...
I20260811 12:40:06.621290 4705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:06.623008 4686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:06.623232 4686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "42efc977a19d46edbc27db41e538d51c"
format_stamp: "Formatted at 2026-08-11 12:40:06 on dist-test-slave-qg60"
server_key: "a992be24d6fa19be0f7a8dc1796d79de"
server_key_iv: "87a36c1a788141e766c58ce91ab00928"
server_key_version: "encryptionkey@0"
I20260811 12:40:06.623466 4686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:06.636899 4686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:06.641552 4686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:06.641878 4686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:06.643014 4686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:06.644685 4686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:06.644825 4686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:40:06.644994 4686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:06.645076 4686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:06.681354 4686 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:42557
I20260811 12:40:06.681469 4839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:42557 every 8 connection(s)
I20260811 12:40:06.682703 4686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:06.691959 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4686
I20260811 12:40:06.692163 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:06.692822 745 external_mini_cluster.cc:1428] Setting key 83b8940efcd033942550a7eb534753f4
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:06.705145 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.685715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:41019 (local address 127.0.186.126:35563)
0811 12:40:06.686175 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:06.686180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:06.687227 (+ 1047us) server_negotiation.cc:407] Connection header received
0811 12:40:06.689130 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:06.689135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:06.689215 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:06.689314 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:06.690871 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.691905 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.694417 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.695082 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.695183 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.699323 (+ 4140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:06.699328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:06.699332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:06.699367 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:06.702109 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.702823 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.702827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.702829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.702947 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.703357 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.703360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.703362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.703624 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:06.703742 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:06.704581 (+ 839us) server_negotiation.cc:299] Negotiation successful
0811 12:40:06.704833 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":230,"threads_started":1}
I20260811 12:40:06.706159 4843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.686329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35563 (local address 127.0.186.67:41019)
0811 12:40:06.687052 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:06.687094 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:06.688847 (+ 1753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:06.689531 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:06.689539 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:06.690116 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:06.690704 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:06.690723 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.692168 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.692176 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:06.694196 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:06.694211 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.695563 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.695571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:06.695888 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.696803 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:06.696833 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:06.699121 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:06.702244 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:06.702252 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:06.702263 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:06.702700 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:06.703049 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:06.703052 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:06.703054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:06.703244 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:06.703782 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:06.703789 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:06.704215 (+ 426us) client_negotiation.cc:769] Sending connection context
0811 12:40:06.704463 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 12:40:06.704972 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":281,"threads_started":1}
I20260811 12:40:06.707939 4840 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35563
I20260811 12:40:06.708391 4840 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:06.709338 4840 heartbeater.cc:511] Master 127.0.186.126:35563 requested a full tablet report, sending...
I20260811 12:40:06.710995 4302 ts_manager.cc:194] Registered new tserver with Master: 42efc977a19d46edbc27db41e538d51c (127.0.186.67:42557)
I20260811 12:40:06.711876 4302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:41019
I20260811 12:40:06.721813 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:06.785315 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.770768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52544 (local address 127.0.186.126:35563)
0811 12:40:06.771048 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:06.771055 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:06.771365 (+ 310us) server_negotiation.cc:407] Connection header received
0811 12:40:06.771515 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:06.771520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:06.771624 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:06.771713 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:06.773226 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.773985 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.775234 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.775640 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.775735 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.779879 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:06.779885 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:06.779889 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:06.779927 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:06.782571 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.783336 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.783340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.783342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.783484 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.783840 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.783843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.783845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.784190 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:06.784386 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:06.784685 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 12:40:06.784950 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 12:40:06.785995 4302 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52544
I20260811 12:40:06.788852 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4370
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:06.805799 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.790011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34556 (local address 127.0.186.65:35637)
0811 12:40:06.790698 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:06.790705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:06.790731 (+ 26us) server_negotiation.cc:407] Connection header received
0811 12:40:06.790789 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:06.790795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:06.791082 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:06.791213 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:06.792395 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.793543 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.794754 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.795399 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.795508 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.800045 (+ 4537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:06.800062 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:06.800104 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:06.800163 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:06.803044 (+ 2881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.803698 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.803705 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.803707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.803849 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.804204 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.804207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.804209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.804567 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:06.804901 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:06.805120 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 12:40:06.805345 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":361,"threads_started":1}
W20260811 12:40:06.807215 4518 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34556
W20260811 12:40:06.808535 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4370: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:40:06.808863 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4370
I20260811 12:40:06.829836 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4530
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:40:06.847641 4855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.830850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60770 (local address 127.0.186.66:42173)
0811 12:40:06.831479 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:06.831486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:06.831513 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:40:06.831579 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:06.831586 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:06.831819 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:06.831961 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:06.833350 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.834416 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.835887 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.836631 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.836877 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.841226 (+ 4349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:06.841238 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:06.841253 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:06.841289 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:06.844688 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.845447 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.845454 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.845457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.845582 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.846001 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.846006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.846013 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.846398 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:06.846663 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:06.846918 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 12:40:06.847294 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":352,"threads_started":1}
W20260811 12:40:06.849295 4674 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60770
W20260811 12:40:06.850557 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4530: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:40:06.850744 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4530
I20260811 12:40:06.871927 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4686
Aug 11 12:40:06 dist-test-slave-qg60 krb5kdc[4251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:40:06.889724 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:06.873047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34762 (local address 127.0.186.67:42557)
0811 12:40:06.873698 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:06.873705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:06.873735 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:40:06.873799 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:06.873805 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:06.874033 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:06.874194 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:06.875586 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.876674 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.878102 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:06.878674 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:06.878777 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:06.883328 (+ 4551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:06.883342 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:06.883358 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:06.883394 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:06.886467 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.887215 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.887225 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.887229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.887427 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:06.887811 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:06.887819 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:06.887824 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:06.888295 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:06.888617 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:06.889040 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 12:40:06.889312 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":325,"threads_started":1}
W20260811 12:40:06.891106 4834 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34762
W20260811 12:40:06.892323 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4686: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:40:06.892555 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4686
I20260811 12:40:06.922732 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4266
I20260811 12:40:06.924062 4335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:07.033607 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4266
2026-08-11T12:40:07Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4102 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:07 dist-test-slave-qg60 krb5kdc[4862](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:07 dist-test-slave-qg60 krb5kdc[4862](info): set up 2 sockets
Aug 11 12:40:07 dist-test-slave-qg60 krb5kdc[4862](info): commencing operation
krb5kdc: starting...
W20260811 12:40:08.237464 745 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.004s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:08 dist-test-slave-qg60 krb5kdc[4862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:08.514176 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:40141
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:40141
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:08.879609 4876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:08.879921 4876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:08.880014 4876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:08.887702 4876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:08.887828 4876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:08.887877 4876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:08.887928 4876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:08.887974 4876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:08.898422 4876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:40141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:40141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:08.899824 4876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:08.901203 4876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:08.914296 4883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:08.914263 4887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:08.914379 4885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:08.915331 4876 server_base.cc:1034] running on GCE node
I20260811 12:40:08.916246 4876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:08.917950 4876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:08.919221 4876 hybrid_clock.cc:648] HybridClock initialized: now 1786452008919172 us; error 49 us; skew 500 ppm
I20260811 12:40:08.919616 4876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:08 dist-test-slave-qg60 krb5kdc[4862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452008, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:08.929104 4876 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:08.931145 4876 webserver.cc:460] Webserver started at http://127.0.186.126:40151/ using document root <none> and password file <none>
I20260811 12:40:08.932058 4876 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:08.932255 4876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:08.932652 4876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:08.936307 4876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "6560d1271d884c778ae383cd24c92022"
format_stamp: "Formatted at 2026-08-11 12:40:08 on dist-test-slave-qg60"
server_key: "c1fe4fa981901c1782b248a0ed23bcc8"
server_key_iv: "e1dc957838da056b7660e068ddbdbbc5"
server_key_version: "encryptionkey@0"
I20260811 12:40:08.937322 4876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "6560d1271d884c778ae383cd24c92022"
format_stamp: "Formatted at 2026-08-11 12:40:08 on dist-test-slave-qg60"
server_key: "c1fe4fa981901c1782b248a0ed23bcc8"
server_key_iv: "e1dc957838da056b7660e068ddbdbbc5"
server_key_version: "encryptionkey@0"
I20260811 12:40:08.943640 4876 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 12:40:08.948060 4895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:08.949875 4876 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:40:08.950115 4876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "6560d1271d884c778ae383cd24c92022"
format_stamp: "Formatted at 2026-08-11 12:40:08 on dist-test-slave-qg60"
server_key: "c1fe4fa981901c1782b248a0ed23bcc8"
server_key_iv: "e1dc957838da056b7660e068ddbdbbc5"
server_key_version: "encryptionkey@0"
I20260811 12:40:08.950436 4876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:08.983083 4876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:08.988093 4876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:08.988468 4876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:09.011492 4876 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:40141
I20260811 12:40:09.011554 4951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:40141 every 8 connection(s)
I20260811 12:40:09.013254 4876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:09.018177 4952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:09.019089 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4876
I20260811 12:40:09.019394 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:09.020133 745 external_mini_cluster.cc:1428] Setting key ebd46583abba363da898628ac70996e2
I20260811 12:40:09.034989 4952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022: Bootstrap starting.
Aug 11 12:40:09 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:09.039461 4952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:09.040650 4952 log.cc:824] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:09.044899 4952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022: No bootstrap required, opened a new log
I20260811 12:40:09.049062 4956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:09.022713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55312 (local address 127.0.186.126:40141)
0811 12:40:09.023791 (+ 1078us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:09.023805 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:09.023859 (+ 54us) server_negotiation.cc:407] Connection header received
0811 12:40:09.025944 (+ 2085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:09.025979 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:09.026509 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:09.026946 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:09.029308 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:09.030840 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:09.032833 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:09.033622 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:09.033838 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:09.039287 (+ 5449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:09.039297 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:09.039314 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:09.039367 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:09.043476 (+ 4109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:09.044581 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:09.044589 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:09.044596 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:09.045034 (+ 438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:09.045541 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:09.045547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:09.045551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:09.046214 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:09.046558 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:09.047145 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 12:40:09.047690 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":513,"threads_started":1}
I20260811 12:40:09.054286 4952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6560d1271d884c778ae383cd24c92022" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40141 } }
I20260811 12:40:09.054787 4952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:09.054919 4952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6560d1271d884c778ae383cd24c92022, State: Initialized, Role: FOLLOWER
I20260811 12:40:09.055604 4952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6560d1271d884c778ae383cd24c92022" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40141 } }
I20260811 12:40:09.055965 4952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:09.056120 4952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:09.056320 4952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:09.058917 4952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6560d1271d884c778ae383cd24c92022" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40141 } }
I20260811 12:40:09.059533 4952 leader_election.cc:302] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6560d1271d884c778ae383cd24c92022; no voters:
I20260811 12:40:09.060186 4952 leader_election.cc:288] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:09.060354 4958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:09.061219 4958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [term 1 LEADER]: Becoming Leader. State: Replica: 6560d1271d884c778ae383cd24c92022, State: Running, Role: LEADER
I20260811 12:40:09.061858 4958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6560d1271d884c778ae383cd24c92022" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40141 } }
I20260811 12:40:09.062716 4952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:09.065930 4959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6560d1271d884c778ae383cd24c92022" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6560d1271d884c778ae383cd24c92022" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40141 } } }
I20260811 12:40:09.065893 4960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6560d1271d884c778ae383cd24c92022. Latest consensus state: current_term: 1 leader_uuid: "6560d1271d884c778ae383cd24c92022" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6560d1271d884c778ae383cd24c92022" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40141 } } }
I20260811 12:40:09.066465 4960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:09.066465 4959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:09.068183 4963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:09.074595 4963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:09.086750 4963 catalog_manager.cc:1347] Generated new cluster ID: 7168357d4542440c847aebcb4d204d8d
I20260811 12:40:09.086920 4963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:09.104969 4963 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:09.106741 4963 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:09.114164 4963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6560d1271d884c778ae383cd24c92022: Generated new TSK 0
I20260811 12:40:09.115224 4963 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:40:09.181443 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40141
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:09.550875 4981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:09.551173 4981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:09.551342 4981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:09.559263 4981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:09.559377 4981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:09.559559 4981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:09.570410 4981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:09.571832 4981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:09.573344 4981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:09.587761 4987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:09.588165 4981 server_base.cc:1034] running on GCE node
W20260811 12:40:09.587733 4993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:09.587792 4988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:09.589247 4981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:09.590303 4981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:09.591578 4981 hybrid_clock.cc:648] HybridClock initialized: now 1786452009591540 us; error 49 us; skew 500 ppm
I20260811 12:40:09.591928 4981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:09 dist-test-slave-qg60 krb5kdc[4862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452009, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:09.595428 4981 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:40:09.597129 4981 webserver.cc:460] Webserver started at http://127.0.186.65:45639/ using document root <none> and password file <none>
I20260811 12:40:09.597843 4981 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:09.597949 4981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:09.598232 4981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:09.601431 4981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "ccad2ca2a3d04837bf112ea105170f69"
format_stamp: "Formatted at 2026-08-11 12:40:09 on dist-test-slave-qg60"
server_key: "6e13b8e4008560a5d60c00515ffa689e"
server_key_iv: "16331fa9bb59460cd3ea779d3d3a496a"
server_key_version: "encryptionkey@0"
I20260811 12:40:09.602188 4981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "ccad2ca2a3d04837bf112ea105170f69"
format_stamp: "Formatted at 2026-08-11 12:40:09 on dist-test-slave-qg60"
server_key: "6e13b8e4008560a5d60c00515ffa689e"
server_key_iv: "16331fa9bb59460cd3ea779d3d3a496a"
server_key_version: "encryptionkey@0"
I20260811 12:40:09.607738 4981 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:40:09.611515 5000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:09.613220 4981 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:09.613406 4981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "ccad2ca2a3d04837bf112ea105170f69"
format_stamp: "Formatted at 2026-08-11 12:40:09 on dist-test-slave-qg60"
server_key: "6e13b8e4008560a5d60c00515ffa689e"
server_key_iv: "16331fa9bb59460cd3ea779d3d3a496a"
server_key_version: "encryptionkey@0"
I20260811 12:40:09.613606 4981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:09.631394 4981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:09.636112 4981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:09.636446 4981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:09.637601 4981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:09.639055 4981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:09.639142 4981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:09.639298 4981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:09.639367 4981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:09.676858 4981 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:36493
I20260811 12:40:09.676918 5125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:36493 every 8 connection(s)
I20260811 12:40:09.678306 4981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:09.680712 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 4981
I20260811 12:40:09.681005 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:09.681835 745 external_mini_cluster.cc:1428] Setting key 443992ce2aaf4a8ffc262a7b75d042b4
Aug 11 12:40:09 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452009, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:09.702080 5130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:09.681256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:37255 (local address 127.0.186.126:40141)
0811 12:40:09.681828 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:09.681836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:09.683167 (+ 1331us) server_negotiation.cc:407] Connection header received
0811 12:40:09.685184 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:09.685192 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:09.685295 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:09.685422 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:09.686983 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:09.688153 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:09.689891 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:09.690626 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:09.690786 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:09.694471 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:09.694480 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:09.694487 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:09.694535 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:09.698342 (+ 3807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:09.699171 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:09.699179 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:09.699185 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:09.699345 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:09.699832 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:09.699840 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:09.699846 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:09.700283 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:09.700444 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:09.701291 (+ 847us) server_negotiation.cc:299] Negotiation successful
0811 12:40:09.701592 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":269,"threads_started":1}
I20260811 12:40:09.702836 5131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:09.681920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40141 (local address 127.0.186.65:37255)
0811 12:40:09.682988 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:09.683037 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:09.684911 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:09.685639 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:09.685647 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:09.686186 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:09.686789 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:09.686807 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:09.688337 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:09.688341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:09.689735 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:09.689748 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:09.690854 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:09.690859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:09.691067 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:09.691807 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:09.691830 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:09.694231 (+ 2401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:09.698513 (+ 4282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:09.698520 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:09.698535 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:09.699004 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:09.699471 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:09.699476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:09.699480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:09.699682 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:09.700422 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:09.700428 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:09.700857 (+ 429us) client_negotiation.cc:769] Sending connection context
0811 12:40:09.701117 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 12:40:09.701537 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":466,"threads_started":1}
I20260811 12:40:09.705312 5127 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40141
I20260811 12:40:09.705694 5127 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:09.706787 5127 heartbeater.cc:511] Master 127.0.186.126:40141 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
I20260811 12:40:09.709640 4913 ts_manager.cc:194] Registered new tserver with Master: ccad2ca2a3d04837bf112ea105170f69 (127.0.186.65:36493)
I20260811 12:40:09.711352 4913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:37255
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:40:09.745553 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40141
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:10.096608 5134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:10.096953 5134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:10.097054 5134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:10.104600 5134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:10.104760 5134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:10.104884 5134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:10.115249 5134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:10.116801 5134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:10.118431 5134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:10.132892 5143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:10.133011 5141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:10.132990 5140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:10.134119 5134 server_base.cc:1034] running on GCE node
I20260811 12:40:10.134804 5134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:10.135841 5134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:10.137084 5134 hybrid_clock.cc:648] HybridClock initialized: now 1786452010137035 us; error 44 us; skew 500 ppm
I20260811 12:40:10.137431 5134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:10.140946 5134 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:40:10.142654 5134 webserver.cc:460] Webserver started at http://127.0.186.66:32847/ using document root <none> and password file <none>
I20260811 12:40:10.143401 5134 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:10.143566 5134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:10.143903 5134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:10.147115 5134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "f09c28036f854616963afd28536c28e4"
format_stamp: "Formatted at 2026-08-11 12:40:10 on dist-test-slave-qg60"
server_key: "5022ece2870359cb81aaa06977c8284d"
server_key_iv: "97fafcb17ea4848991e18f82fa57d046"
server_key_version: "encryptionkey@0"
I20260811 12:40:10.147996 5134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "f09c28036f854616963afd28536c28e4"
format_stamp: "Formatted at 2026-08-11 12:40:10 on dist-test-slave-qg60"
server_key: "5022ece2870359cb81aaa06977c8284d"
server_key_iv: "97fafcb17ea4848991e18f82fa57d046"
server_key_version: "encryptionkey@0"
I20260811 12:40:10.153820 5134 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:40:10.157987 5150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:10.159513 5134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:40:10.159718 5134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "f09c28036f854616963afd28536c28e4"
format_stamp: "Formatted at 2026-08-11 12:40:10 on dist-test-slave-qg60"
server_key: "5022ece2870359cb81aaa06977c8284d"
server_key_iv: "97fafcb17ea4848991e18f82fa57d046"
server_key_version: "encryptionkey@0"
I20260811 12:40:10.159974 5134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:10.192986 5134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:10.197649 5134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:10.198040 5134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:10.199203 5134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:10.200699 5134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:10.200839 5134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:40:10.201005 5134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:10.201084 5134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:10.239064 5134 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:36355
I20260811 12:40:10.239115 5276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:36355 every 8 connection(s)
I20260811 12:40:10.240509 5134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:10.243181 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 5134
I20260811 12:40:10.243424 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:10.244047 745 external_mini_cluster.cc:1428] Setting key 7a08c6c8ad2973e1ab808a435de20267
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:10.267412 5279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.243354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:56033 (local address 127.0.186.126:40141)
0811 12:40:10.243934 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:10.243941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:10.245263 (+ 1322us) server_negotiation.cc:407] Connection header received
0811 12:40:10.247744 (+ 2481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:10.247748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:10.247828 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:10.247924 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:10.250225 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.250991 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.253607 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.254165 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.254328 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.259008 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:10.259017 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:10.259026 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:10.259079 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:10.263194 (+ 4115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.264350 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.264359 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.264365 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.264541 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.265117 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.265125 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.265128 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.265571 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:10.265768 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:10.266574 (+ 806us) server_negotiation.cc:299] Negotiation successful
0811 12:40:10.266878 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":360,"threads_started":1}
I20260811 12:40:10.268131 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.244110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40141 (local address 127.0.186.66:56033)
0811 12:40:10.245047 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:10.245117 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:10.247431 (+ 2314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:10.248229 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:10.248243 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:10.249167 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:10.250011 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:10.250039 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.251170 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.251178 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:10.253440 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:10.253459 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.254436 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.254447 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:10.254791 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.255656 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:10.255692 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:10.258691 (+ 2999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:10.263439 (+ 4748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:10.263450 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:10.263471 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:10.264172 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:10.264684 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:10.264691 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:10.264695 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:10.264961 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:10.265723 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:10.265731 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:10.266146 (+ 415us) client_negotiation.cc:769] Sending connection context
0811 12:40:10.266398 (+ 252us) client_negotiation.cc:240] Negotiation successful
0811 12:40:10.266829 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":391,"threads_started":1}
I20260811 12:40:10.269928 5277 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40141
I20260811 12:40:10.270282 5277 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:10.271107 5277 heartbeater.cc:511] Master 127.0.186.126:40141 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
I20260811 12:40:10.272820 4913 ts_manager.cc:194] Registered new tserver with Master: f09c28036f854616963afd28536c28e4 (127.0.186.66:36355)
I20260811 12:40:10.273702 4913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:56033
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:40:10.309449 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40141
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:34059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:10.663272 5284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:10.663621 5284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:10.663857 5284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:10.671449 5284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:10.671578 5284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:10.671765 5284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:10.682512 5284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:10.683844 5284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:10.685271 5284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:10.698926 5289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:10.699071 5291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:10.699232 5293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:10.700176 5284 server_base.cc:1034] running on GCE node
I20260811 12:40:10.700945 5284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:10.702034 5284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:10.703285 5284 hybrid_clock.cc:648] HybridClock initialized: now 1786452010703228 us; error 50 us; skew 500 ppm
I20260811 12:40:10.703639 5284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:10.707371 5284 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:40:10.709965 5284 webserver.cc:460] Webserver started at http://127.0.186.67:39737/ using document root <none> and password file <none>
I20260811 12:40:10.710723 5284 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:10.710884 5284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:10.711246 5284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:10.714696 5127 heartbeater.cc:503] Master 127.0.186.126:40141 was elected leader, sending a full tablet report...
I20260811 12:40:10.714426 5284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "eed5c6ee25aa4299b751a6e36b338a9e"
format_stamp: "Formatted at 2026-08-11 12:40:10 on dist-test-slave-qg60"
server_key: "399514c7f98d53a5aada9a1cd36f74b9"
server_key_iv: "e317462a94dd9a025450140f4c3ad6b2"
server_key_version: "encryptionkey@0"
I20260811 12:40:10.715348 5284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "eed5c6ee25aa4299b751a6e36b338a9e"
format_stamp: "Formatted at 2026-08-11 12:40:10 on dist-test-slave-qg60"
server_key: "399514c7f98d53a5aada9a1cd36f74b9"
server_key_iv: "e317462a94dd9a025450140f4c3ad6b2"
server_key_version: "encryptionkey@0"
I20260811 12:40:10.721235 5284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260811 12:40:10.724917 5300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:10.726397 5284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:10.726616 5284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "eed5c6ee25aa4299b751a6e36b338a9e"
format_stamp: "Formatted at 2026-08-11 12:40:10 on dist-test-slave-qg60"
server_key: "399514c7f98d53a5aada9a1cd36f74b9"
server_key_iv: "e317462a94dd9a025450140f4c3ad6b2"
server_key_version: "encryptionkey@0"
I20260811 12:40:10.726853 5284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:10.758524 5284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:10.763449 5284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:10.763797 5284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:10.765080 5284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:10.766634 5284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:10.766752 5284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:10.766909 5284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:10.766988 5284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:10.807075 5284 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:36769
I20260811 12:40:10.807216 5440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:36769 every 8 connection(s)
I20260811 12:40:10.808525 5284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:10.817792 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 5284
I20260811 12:40:10.818037 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:10.818567 745 external_mini_cluster.cc:1428] Setting key 13bf3eedd3a7798f80f0b036f9455e93
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:10.832345 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.811558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:59371 (local address 127.0.186.126:40141)
0811 12:40:10.812055 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:10.812061 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:10.813221 (+ 1160us) server_negotiation.cc:407] Connection header received
0811 12:40:10.815060 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:10.815065 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:10.815155 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:10.815270 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:10.817318 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.818642 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.821217 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.821642 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.821754 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.825774 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:10.825780 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:10.825783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:10.825835 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:10.828659 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.829651 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.829655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.829657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.829793 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.830238 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.830241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.830243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.830586 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:10.830751 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:10.831643 (+ 892us) server_negotiation.cc:299] Negotiation successful
0811 12:40:10.831906 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":229,"threads_started":1}
I20260811 12:40:10.833675 5444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.812205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40141 (local address 127.0.186.67:59371)
0811 12:40:10.813031 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:10.813072 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:10.814764 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:10.815567 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:10.815576 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:10.816270 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:10.817033 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:10.817056 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.818937 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.818945 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:10.821054 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:10.821074 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.821935 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.821945 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:10.822301 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.822975 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:10.823003 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:10.825494 (+ 2491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:10.828962 (+ 3468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:10.828971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:10.828986 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:10.829497 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:10.829904 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:10.829908 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:10.829910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:10.830121 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:10.830741 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:10.830748 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:10.831156 (+ 408us) client_negotiation.cc:769] Sending connection context
0811 12:40:10.831490 (+ 334us) client_negotiation.cc:240] Negotiation successful
0811 12:40:10.832139 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":326,"threads_started":1}
I20260811 12:40:10.835304 5441 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40141
I20260811 12:40:10.835640 5441 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:10.836421 5441 heartbeater.cc:511] Master 127.0.186.126:40141 requested a full tablet report, sending...
I20260811 12:40:10.838044 4912 ts_manager.cc:194] Registered new tserver with Master: eed5c6ee25aa4299b751a6e36b338a9e (127.0.186.67:36769)
I20260811 12:40:10.838987 4912 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:59371
I20260811 12:40:10.847771 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:10.911343 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.894869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34342 (local address 127.0.186.65:36493)
0811 12:40:10.895677 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:10.895686 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:10.895721 (+ 35us) server_negotiation.cc:407] Connection header received
0811 12:40:10.895784 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:10.895790 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:10.896005 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:10.896194 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:10.897826 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.898899 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.900207 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.900861 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.901012 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.905250 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:10.905263 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:10.905278 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:10.905315 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:10.908155 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.909005 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.909019 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.909022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.909159 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.909596 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.909600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.909602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.909969 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:10.910346 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:10.910665 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 12:40:10.910969 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":398,"threads_started":1}
Aug 11 12:40:10 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:10.931324 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.915945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55320 (local address 127.0.186.126:40141)
0811 12:40:10.916195 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:10.916202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:10.916495 (+ 293us) server_negotiation.cc:407] Connection header received
0811 12:40:10.916705 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:10.916711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:10.916813 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:10.916940 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:10.918425 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.919190 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.920522 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.921053 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.921200 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.925606 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:10.925612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:10.925615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:10.925655 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:10.928385 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.929245 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.929251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.929254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.929389 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.929775 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.929779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.929782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.930147 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:10.930427 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:10.930734 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 12:40:10.930983 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260811 12:40:10.932061 4912 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55320
I20260811 12:40:10.933343 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4981
I20260811 12:40:10.947517 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:10.934334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34354 (local address 127.0.186.65:36493)
0811 12:40:10.934576 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:10.934582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:10.934802 (+ 220us) server_negotiation.cc:407] Connection header received
0811 12:40:10.935014 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:10.935019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:10.935102 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:10.935223 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:10.936482 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.937305 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.938603 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:10.939048 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:10.939200 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:10.941788 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:10.941793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:10.941796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:10.941850 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:10.944658 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.945438 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.945450 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.945454 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.945588 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:10.946007 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:10.946012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:10.946015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:10.946317 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:10.946596 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:10.946933 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 12:40:10.947175 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 12:40:10.948254 5120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:11.043067 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4981
I20260811 12:40:11.068002 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 5134
Aug 11 12:40:11 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:40:11.086053 5456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:11.069105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45656 (local address 127.0.186.66:36355)
0811 12:40:11.069656 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:11.069663 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:11.069688 (+ 25us) server_negotiation.cc:407] Connection header received
0811 12:40:11.069758 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:11.069764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:11.069973 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:11.070177 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:11.071493 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:11.072574 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:11.074129 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:11.074692 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:11.074863 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:11.079425 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:11.079439 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:11.079455 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:11.079495 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:11.082726 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:11.083542 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:11.083550 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:11.083552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:11.083689 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:11.084132 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:11.084136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:11.084138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:11.084543 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:11.085009 (+ 466us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:11.085367 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 12:40:11.085658 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":262,"threads_started":1}
I20260811 12:40:11.087463 5271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:11.174546 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 5134
I20260811 12:40:11.197271 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 5284
Aug 11 12:40:11 dist-test-slave-qg60 krb5kdc[4862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:40:11.214113 5458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:11.198268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46440 (local address 127.0.186.67:36769)
0811 12:40:11.198958 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:11.198966 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:11.198999 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:40:11.199063 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:11.199070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:11.199311 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:11.199446 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:11.200831 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:11.201871 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:11.203150 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:11.203711 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:11.203818 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:11.208479 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:11.208493 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:11.208508 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:11.208553 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:11.211486 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:11.212183 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:11.212190 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:11.212192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:11.212319 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:11.212647 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:11.212650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:11.212652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:11.213079 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:11.213363 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:11.213588 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 12:40:11.213810 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":349,"threads_started":1}
I20260811 12:40:11.215512 5434 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:11.300909 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 5284
I20260811 12:40:11.322434 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 4876
I20260811 12:40:11.323956 4947 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:11.438735 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 4876
2026-08-11T12:40:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4404 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:11 dist-test-slave-qg60 krb5kdc[5463](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:11 dist-test-slave-qg60 krb5kdc[5463](info): set up 2 sockets
Aug 11 12:40:11 dist-test-slave-qg60 krb5kdc[5463](info): commencing operation
krb5kdc: starting...
W20260811 12:40:12.654301 745 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.005s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:12 dist-test-slave-qg60 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:12.946014 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:43323
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:43323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:13.301915 5479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:13.302225 5479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:13.302429 5479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:13.309935 5479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:13.310065 5479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:13.310187 5479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:13.310278 5479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:13.310354 5479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:13.320741 5479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:43323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:43323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:13.322185 5479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:13.323784 5479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:13.336282 5485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:13.336318 5489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:13.336349 5486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:13.337433 5479 server_base.cc:1034] running on GCE node
I20260811 12:40:13.338280 5479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:13.339712 5479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:13.341013 5479 hybrid_clock.cc:648] HybridClock initialized: now 1786452013340930 us; error 57 us; skew 500 ppm
I20260811 12:40:13.341430 5479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:13 dist-test-slave-qg60 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452013, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:13.345477 5479 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:13.346663 5479 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:13.346764 5479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:13.347061 5479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:13.350302 5479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "3736c09c26fa47fa8e8f3a1a27cab25f"
format_stamp: "Formatted at 2026-08-11 12:40:13 on dist-test-slave-qg60"
server_key: "0bbd0a5ae0fb89a28f16ad42d9b31c57"
server_key_iv: "c2952c27bf419d17767e5c67a541e144"
server_key_version: "encryptionkey@0"
I20260811 12:40:13.351112 5479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "3736c09c26fa47fa8e8f3a1a27cab25f"
format_stamp: "Formatted at 2026-08-11 12:40:13 on dist-test-slave-qg60"
server_key: "0bbd0a5ae0fb89a28f16ad42d9b31c57"
server_key_iv: "c2952c27bf419d17767e5c67a541e144"
server_key_version: "encryptionkey@0"
I20260811 12:40:13.356678 5479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:40:13.360611 5495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:13.362375 5479 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:40:13.362610 5479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "3736c09c26fa47fa8e8f3a1a27cab25f"
format_stamp: "Formatted at 2026-08-11 12:40:13 on dist-test-slave-qg60"
server_key: "0bbd0a5ae0fb89a28f16ad42d9b31c57"
server_key_iv: "c2952c27bf419d17767e5c67a541e144"
server_key_version: "encryptionkey@0"
I20260811 12:40:13.362885 5479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:13.389509 5479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:13.393973 5479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:13.394281 5479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:13.414989 5479 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:43323
I20260811 12:40:13.415015 5558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:43323 every 8 connection(s)
I20260811 12:40:13.415931 5479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:13.419850 5559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:13.425014 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 5479
I20260811 12:40:13.425305 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:13.425992 745 external_mini_cluster.cc:1428] Setting key 21972070cad1a388a53c8768f399367d
I20260811 12:40:13.433108 5559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f: Bootstrap starting.
I20260811 12:40:13.437083 5559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:13.438208 5559 log.cc:824] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:13.441555 5559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f: No bootstrap required, opened a new log
Aug 11 12:40:13 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:13.452497 5559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43323 } }
I20260811 12:40:13.453037 5559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:13.453150 5559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3736c09c26fa47fa8e8f3a1a27cab25f, State: Initialized, Role: FOLLOWER
I20260811 12:40:13.453620 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:13.428286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48576 (local address 127.0.186.126:43323)
0811 12:40:13.429355 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:13.429370 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:13.429427 (+ 57us) server_negotiation.cc:407] Connection header received
0811 12:40:13.432155 (+ 2728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:13.432187 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:13.432755 (+ 568us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:13.433284 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:13.434831 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:13.436938 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:13.438373 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:13.439392 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:13.439533 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:13.443892 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:13.443905 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:13.443924 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:13.443974 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:13.448275 (+ 4301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:13.449142 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:13.449151 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:13.449162 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:13.449405 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:13.449833 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:13.449839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:13.449842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:13.450700 (+ 858us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:13.451009 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:13.451438 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 12:40:13.452010 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":504,"threads_started":1}
I20260811 12:40:13.453883 5559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43323 } }
I20260811 12:40:13.454342 5559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:13.454531 5559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:13.454800 5559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:13.457625 5559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43323 } }
I20260811 12:40:13.458175 5559 leader_election.cc:302] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3736c09c26fa47fa8e8f3a1a27cab25f; no voters:
I20260811 12:40:13.458824 5559 leader_election.cc:288] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:13.458998 5564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:13.459892 5564 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [term 1 LEADER]: Becoming Leader. State: Replica: 3736c09c26fa47fa8e8f3a1a27cab25f, State: Running, Role: LEADER
I20260811 12:40:13.460486 5564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43323 } }
I20260811 12:40:13.461402 5559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:13.463567 5566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3736c09c26fa47fa8e8f3a1a27cab25f. Latest consensus state: current_term: 1 leader_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43323 } } }
I20260811 12:40:13.463904 5566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:13.469447 5565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3736c09c26fa47fa8e8f3a1a27cab25f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43323 } } }
I20260811 12:40:13.469848 5565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:13.470137 5569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:13.478003 5569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:13.483963 5581 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 12:40:13.490993 5569 catalog_manager.cc:1347] Generated new cluster ID: 09be34d7005d42169fd1e26b94e33b33
I20260811 12:40:13.491142 5569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:13.519129 5569 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:13.522382 5569 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:13.535298 5569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f: Generated new TSK 0
I20260811 12:40:13.536419 5569 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:40:13.605007 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43323
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:13.968086 5585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:13.968407 5585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:13.968511 5585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:13.976864 5585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:13.977005 5585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:13.977134 5585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:13.987885 5585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:13.989555 5585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:13.991104 5585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:14.006381 5594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:14.006356 5590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:14.006572 5592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:14.007514 5585 server_base.cc:1034] running on GCE node
I20260811 12:40:14.008332 5585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:14.009594 5585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:14.010880 5585 hybrid_clock.cc:648] HybridClock initialized: now 1786452014010831 us; error 34 us; skew 500 ppm
I20260811 12:40:14.011336 5585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:14 dist-test-slave-qg60 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452014, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:14.022545 5585 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:40:14.023980 5585 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:14.024144 5585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:14.024562 5585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:14.028067 5585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "dbf603cbea564824a81cab012fc8afba"
format_stamp: "Formatted at 2026-08-11 12:40:14 on dist-test-slave-qg60"
server_key: "84196f7e998d37702cc31c74e788781d"
server_key_iv: "4acb7b8daaa642bd13434d61b704f45d"
server_key_version: "encryptionkey@0"
I20260811 12:40:14.029294 5585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "dbf603cbea564824a81cab012fc8afba"
format_stamp: "Formatted at 2026-08-11 12:40:14 on dist-test-slave-qg60"
server_key: "84196f7e998d37702cc31c74e788781d"
server_key_iv: "4acb7b8daaa642bd13434d61b704f45d"
server_key_version: "encryptionkey@0"
I20260811 12:40:14.035193 5585 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:40:14.039314 5602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:14.040947 5585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:14.041148 5585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "dbf603cbea564824a81cab012fc8afba"
format_stamp: "Formatted at 2026-08-11 12:40:14 on dist-test-slave-qg60"
server_key: "84196f7e998d37702cc31c74e788781d"
server_key_iv: "4acb7b8daaa642bd13434d61b704f45d"
server_key_version: "encryptionkey@0"
I20260811 12:40:14.041460 5585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:14.060572 5585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:14.065840 5585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:14.066274 5585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:14.067478 5585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:14.069116 5585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:14.069270 5585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:14.069458 5585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:14.069566 5585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:14.110047 5585 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:34681
I20260811 12:40:14.110165 5737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:34681 every 8 connection(s)
I20260811 12:40:14.111122 5585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:14.113790 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 5585
I20260811 12:40:14.113984 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:14.114852 745 external_mini_cluster.cc:1428] Setting key ae334554b3a71d5a06e9365ecda25237
Aug 11 12:40:14 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452014, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:14.137303 5741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:14.114469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:36065 (local address 127.0.186.126:43323)
0811 12:40:14.115095 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:14.115102 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:14.116290 (+ 1188us) server_negotiation.cc:407] Connection header received
0811 12:40:14.119125 (+ 2835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:14.119130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:14.119212 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:14.119311 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:14.121831 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.122584 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.125347 (+ 2763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.125810 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.125929 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:14.130340 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:14.130349 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:14.130357 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:14.130420 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:14.133703 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:14.134651 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:14.134656 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:14.134658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:14.134797 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:14.135320 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:14.135325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:14.135327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:14.135620 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:14.135797 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:14.136611 (+ 814us) server_negotiation.cc:299] Negotiation successful
0811 12:40:14.136904 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":304,"threads_started":1}
I20260811 12:40:14.138409 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:14.115106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:43323 (local address 127.0.186.65:36065)
0811 12:40:14.116123 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:14.116166 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:14.118659 (+ 2493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:14.119647 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:14.119663 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:14.120610 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:14.121578 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:14.121611 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.122785 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.122793 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:14.125143 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:14.125165 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.126093 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.126102 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:14.126459 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:14.127450 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:14.127487 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:14.130012 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:14.133911 (+ 3899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:14.133921 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:14.133945 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:14.134474 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:14.134932 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:14.134938 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:14.134941 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:14.135170 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:14.135778 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:14.135787 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:14.136178 (+ 391us) client_negotiation.cc:769] Sending connection context
0811 12:40:14.136482 (+ 304us) client_negotiation.cc:240] Negotiation successful
0811 12:40:14.137161 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":414,"threads_started":1}
I20260811 12:40:14.140367 5738 heartbeater.cc:347] Connected to a master server at 127.0.186.126:43323
I20260811 12:40:14.140774 5738 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:14.141580 5738 heartbeater.cc:511] Master 127.0.186.126:43323 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
I20260811 12:40:14.144074 5516 ts_manager.cc:194] Registered new tserver with Master: dbf603cbea564824a81cab012fc8afba (127.0.186.65:34681)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
I20260811 12:40:14.146174 5516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:36065
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:40:14.178699 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43323
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:14.540511 5745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:14.540895 5745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:14.541115 5745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:14.548849 5745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:14.549021 5745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:14.549217 5745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:14.559463 5745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:14.560915 5745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:14.562392 5745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:14.576975 5751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:14.577024 5754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:14.577067 5752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:14.577739 5745 server_base.cc:1034] running on GCE node
I20260811 12:40:14.578401 5745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:14.579485 5745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:14.580794 5745 hybrid_clock.cc:648] HybridClock initialized: now 1786452014580697 us; error 67 us; skew 500 ppm
I20260811 12:40:14.581156 5745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:14 dist-test-slave-qg60 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452014, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:14.584647 5745 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:40:14.585996 5745 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:14.586159 5745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:14.586589 5745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:14.589846 5745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "196edbf161044099bb4b645e96a94c4e"
format_stamp: "Formatted at 2026-08-11 12:40:14 on dist-test-slave-qg60"
server_key: "085632789df64a3fc6a9841b15f0f24d"
server_key_iv: "c5656b7dc4ac1ac9bc3c475f15af4f2c"
server_key_version: "encryptionkey@0"
I20260811 12:40:14.590746 5745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "196edbf161044099bb4b645e96a94c4e"
format_stamp: "Formatted at 2026-08-11 12:40:14 on dist-test-slave-qg60"
server_key: "085632789df64a3fc6a9841b15f0f24d"
server_key_iv: "c5656b7dc4ac1ac9bc3c475f15af4f2c"
server_key_version: "encryptionkey@0"
I20260811 12:40:14.596189 5745 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:40:14.599905 5763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:14.601435 5745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:14.601632 5745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "196edbf161044099bb4b645e96a94c4e"
format_stamp: "Formatted at 2026-08-11 12:40:14 on dist-test-slave-qg60"
server_key: "085632789df64a3fc6a9841b15f0f24d"
server_key_iv: "c5656b7dc4ac1ac9bc3c475f15af4f2c"
server_key_version: "encryptionkey@0"
I20260811 12:40:14.601886 5745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:14.618636 5745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:14.623386 5745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:14.623739 5745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:14.624955 5745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:14.626508 5745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:14.626641 5745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:14.626780 5745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:14.626876 5745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:14.663579 5745 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:46259
I20260811 12:40:14.663645 5895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:46259 every 8 connection(s)
I20260811 12:40:14.664522 5745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:14.666594 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 5745
I20260811 12:40:14.666819 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:14.667366 745 external_mini_cluster.cc:1428] Setting key 227c1852b7dc6015ec83ae313fdad867
Aug 11 12:40:14 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452014, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:14.688721 5898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:14.667528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:40827 (local address 127.0.186.126:43323)
0811 12:40:14.668043 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:14.668052 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:14.669473 (+ 1421us) server_negotiation.cc:407] Connection header received
0811 12:40:14.671538 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:14.671543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:14.671648 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:14.671786 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:14.673711 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.674454 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.676239 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.676722 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.676953 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:14.681771 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:14.681777 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:14.681780 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:14.681821 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:14.684838 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:14.685969 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:14.685973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:14.685975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:14.686120 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:14.686652 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:14.686655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:14.686657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:14.687031 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:14.687166 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:14.688235 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0811 12:40:14.688425 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":266,"threads_started":1}
I20260811 12:40:14.690477 5899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:14.668243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:43323 (local address 127.0.186.66:40827)
0811 12:40:14.669249 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:14.669305 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:14.671184 (+ 1879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:14.672095 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:14.672105 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:14.672844 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:14.673506 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:14.673526 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.674662 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.674666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:14.676043 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:14.676058 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:14.677076 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:14.677084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:14.677327 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:14.678144 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:14.678175 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:14.681447 (+ 3272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:14.685018 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:14.685034 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:14.685060 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:14.685821 (+ 761us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:14.686243 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:14.686251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:14.686257 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:14.686522 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:14.687197 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:14.687208 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:14.687738 (+ 530us) client_negotiation.cc:769] Sending connection context
0811 12:40:14.688072 (+ 334us) client_negotiation.cc:240] Negotiation successful
0811 12:40:14.688801 (+ 729us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":434,"threads_started":1}
I20260811 12:40:14.692229 5896 heartbeater.cc:347] Connected to a master server at 127.0.186.126:43323
I20260811 12:40:14.692579 5896 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:14.693383 5896 heartbeater.cc:511] Master 127.0.186.126:43323 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
I20260811 12:40:14.695080 5516 ts_manager.cc:194] Registered new tserver with Master: 196edbf161044099bb4b645e96a94c4e (127.0.186.66:46259)
I20260811 12:40:14.695973 5516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:40827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:40:14.730006 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43323
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:15.092571 5902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:15.093030 5902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:15.093216 5902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:15.101238 5902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:15.101344 5902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:15.101552 5902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:15.112485 5902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:15.113823 5902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:15.115187 5902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:15.129922 5910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:15.129853 5907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:15.129853 5908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:15.130669 5902 server_base.cc:1034] running on GCE node
I20260811 12:40:15.131443 5902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:15.132473 5902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:15.133735 5902 hybrid_clock.cc:648] HybridClock initialized: now 1786452015133651 us; error 71 us; skew 500 ppm
I20260811 12:40:15.134187 5902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:15 dist-test-slave-qg60 krb5kdc[5463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452015, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:15.137590 5902 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:40:15.138919 5902 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:15.139019 5902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:15.139331 5902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:15.142477 5902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "3633e0a056bc4eb5b7cae137fd803348"
format_stamp: "Formatted at 2026-08-11 12:40:15 on dist-test-slave-qg60"
server_key: "651c4727a3320bcb974a469e586d387d"
server_key_iv: "f7292443e41d6b27bdb0811e42ce390d"
server_key_version: "encryptionkey@0"
I20260811 12:40:15.143294 5902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "3633e0a056bc4eb5b7cae137fd803348"
format_stamp: "Formatted at 2026-08-11 12:40:15 on dist-test-slave-qg60"
server_key: "651c4727a3320bcb974a469e586d387d"
server_key_iv: "f7292443e41d6b27bdb0811e42ce390d"
server_key_version: "encryptionkey@0"
I20260811 12:40:15.148869 5902 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:40:15.150152 5738 heartbeater.cc:503] Master 127.0.186.126:43323 was elected leader, sending a full tablet report...
I20260811 12:40:15.152830 5916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:15.154265 5902 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:15.154466 5902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "3633e0a056bc4eb5b7cae137fd803348"
format_stamp: "Formatted at 2026-08-11 12:40:15 on dist-test-slave-qg60"
server_key: "651c4727a3320bcb974a469e586d387d"
server_key_iv: "f7292443e41d6b27bdb0811e42ce390d"
server_key_version: "encryptionkey@0"
I20260811 12:40:15.154698 5902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:15.183743 5902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:15.189299 5902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:15.189651 5902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:15.190999 5902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:15.192626 5902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:15.192798 5902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:15.192927 5902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:15.192998 5902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:15.231910 5902 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:42651
I20260811 12:40:15.231942 6054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:42651 every 8 connection(s)
I20260811 12:40:15.233093 5902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:15.240051 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 5902
I20260811 12:40:15.240331 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:15.240891 745 external_mini_cluster.cc:1428] Setting key 4f366d0d891821e1bd606cb472471257
Aug 11 12:40:15 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452015, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:15.256944 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.236053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:52645 (local address 127.0.186.126:43323)
0811 12:40:15.236587 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.236592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.237910 (+ 1318us) server_negotiation.cc:407] Connection header received
0811 12:40:15.240256 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.240265 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.240369 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.240529 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:15.242849 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.243746 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.245862 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.246340 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.246499 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.250339 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:15.250343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:15.250346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:15.250382 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:15.253116 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.253933 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.253939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.253945 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.254076 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.254559 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.254574 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.254576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.254941 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:15.255104 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.256222 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.256452 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":281,"threads_started":1}
I20260811 12:40:15.258138 6058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.236894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:43323 (local address 127.0.186.67:52645)
0811 12:40:15.237717 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:15.237759 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:15.239770 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:15.240919 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:15.240928 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:15.241752 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:15.242654 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.242678 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.243944 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.243948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.245680 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.245694 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.246610 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.246619 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.246857 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.247608 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:15.247647 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:15.250080 (+ 2433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:15.253280 (+ 3200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:15.253291 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:15.253311 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:15.253780 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:15.254203 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:15.254208 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:15.254212 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:15.254421 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:15.255111 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:15.255120 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:15.255663 (+ 543us) client_negotiation.cc:769] Sending connection context
0811 12:40:15.256047 (+ 384us) client_negotiation.cc:240] Negotiation successful
0811 12:40:15.256653 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":340,"threads_started":1}
I20260811 12:40:15.259742 6055 heartbeater.cc:347] Connected to a master server at 127.0.186.126:43323
I20260811 12:40:15.260074 6055 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:15.260865 6055 heartbeater.cc:511] Master 127.0.186.126:43323 requested a full tablet report, sending...
I20260811 12:40:15.262472 5516 ts_manager.cc:194] Registered new tserver with Master: 3633e0a056bc4eb5b7cae137fd803348 (127.0.186.67:42651)
I20260811 12:40:15.263264 5516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:52645
I20260811 12:40:15.269546 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:40:15.287107 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.274372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48582 (local address 127.0.186.126:43323)
0811 12:40:15.274569 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.274574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.275144 (+ 570us) server_negotiation.cc:407] Connection header received
0811 12:40:15.275295 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.275299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.275361 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.275448 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:15.277042 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.277818 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.279056 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.279473 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.279569 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.282017 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:15.282021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:15.282025 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:15.282056 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:15.284582 (+ 2526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.285315 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.285319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.285321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.285442 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.285826 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.285829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.285831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.286161 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:15.286357 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.286648 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.286834 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 12:40:15.291771 5516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:15.299384 5516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:15.335692 6071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.314252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:42651 (local address 127.0.0.1:47858)
0811 12:40:15.326208 (+ 11956us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:15.326234 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:15.326379 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:15.327899 (+ 1520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:15.327909 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:15.327955 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:15.328412 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.328426 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.331005 (+ 2579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.331010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.333118 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.333134 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.334597 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.334605 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.334861 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.334932 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 12:40:15.335091 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 12:40:15.335292 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11763,"thread_start_us":10511,"threads_started":1}
I20260811 12:40:15.335817 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.314910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47858 (local address 127.0.186.67:42651)
0811 12:40:15.327046 (+ 12136us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.327052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.327105 (+ 53us) server_negotiation.cc:407] Connection header received
0811 12:40:15.327260 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.327269 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.327568 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.327849 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:15.328663 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.330849 (+ 2186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.333301 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.334304 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.334473 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.334746 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.335174 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.335391 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11963,"thread_start_us":11794,"threads_started":1}
I20260811 12:40:15.338095 6072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.313755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:46259 (local address 127.0.0.1:58372)
0811 12:40:15.324572 (+ 10817us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:15.324644 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:15.325529 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:15.329342 (+ 3813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:15.329347 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:15.329376 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:15.329759 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.329771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.331903 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.331912 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.334712 (+ 2800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.334729 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.337260 (+ 2531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.337267 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.337465 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.337506 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 12:40:15.337577 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 12:40:15.337673 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10440,"mutex_wait_us":133,"thread_start_us":12094,"threads_started":1}
I20260811 12:40:15.338450 6075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.327894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:34681 (local address 127.0.0.1:46568)
0811 12:40:15.329052 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:15.329068 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:15.329243 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:15.329810 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:15.329815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:15.329840 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:15.330283 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.330296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.332001 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.332006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.335042 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.335086 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.337497 (+ 2411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.337503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.337687 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.337724 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 12:40:15.337831 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 12:40:15.337971 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1029,"mutex_wait_us":133,"thread_start_us":843,"threads_started":1}
I20260811 12:40:15.338476 6074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.326847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.0.186.65:34681)
0811 12:40:15.327716 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.327726 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.329205 (+ 1479us) server_negotiation.cc:407] Connection header received
0811 12:40:15.329430 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.329436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.329597 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.329823 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:15.330518 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.331792 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.335285 (+ 3493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.336913 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.337068 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.337338 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.337911 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.338108 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":414,"threads_started":1}
I20260811 12:40:15.339507 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.313747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58372 (local address 127.0.186.66:46259)
0811 12:40:15.328622 (+ 14875us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.328631 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.328658 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:40:15.328785 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.328795 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.329107 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.329974 (+ 867us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:15.330249 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.331745 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.334904 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.337007 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.338706 (+ 1699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.338927 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.339017 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.339199 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14698,"thread_start_us":14553,"threads_started":1}
I20260811 12:40:15.340617 5967 tablet_service.cc:1467] Processing CreateTablet for tablet b7d88313f02245d3b7fc45d931e42f1e (DEFAULT_TABLE table=test-table [id=791ae6f5096548ec923370367de65a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:15.342098 5967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d88313f02245d3b7fc45d931e42f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:15.342396 5657 tablet_service.cc:1467] Processing CreateTablet for tablet b7d88313f02245d3b7fc45d931e42f1e (DEFAULT_TABLE table=test-table [id=791ae6f5096548ec923370367de65a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:15.343001 5816 tablet_service.cc:1467] Processing CreateTablet for tablet b7d88313f02245d3b7fc45d931e42f1e (DEFAULT_TABLE table=test-table [id=791ae6f5096548ec923370367de65a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:15.343914 5657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d88313f02245d3b7fc45d931e42f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:15.344349 5816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d88313f02245d3b7fc45d931e42f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:15.354748 6076 tablet_bootstrap.cc:492] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Bootstrap starting.
I20260811 12:40:15.358331 6076 tablet_bootstrap.cc:654] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:15.359797 6076 log.cc:824] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:15.361400 6079 tablet_bootstrap.cc:492] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Bootstrap starting.
I20260811 12:40:15.363528 6076 tablet_bootstrap.cc:492] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: No bootstrap required, opened a new log
I20260811 12:40:15.363931 6076 ts_tablet_manager.cc:1397] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 12:40:15.365408 6079 tablet_bootstrap.cc:654] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:15.366770 6079 log.cc:824] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:15.368058 6077 tablet_bootstrap.cc:492] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Bootstrap starting.
I20260811 12:40:15.371129 6079 tablet_bootstrap.cc:492] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: No bootstrap required, opened a new log
I20260811 12:40:15.371515 6079 ts_tablet_manager.cc:1397] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260811 12:40:15.372103 6077 tablet_bootstrap.cc:654] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:15.373454 6077 log.cc:824] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:15.375718 6076 raft_consensus.cc:348] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.376216 6076 raft_consensus.cc:374] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:15.376335 6076 raft_consensus.cc:729] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3633e0a056bc4eb5b7cae137fd803348, State: Initialized, Role: FOLLOWER
I20260811 12:40:15.377090 6077 tablet_bootstrap.cc:492] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: No bootstrap required, opened a new log
I20260811 12:40:15.377048 6076 consensus_queue.cc:260] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.377390 6077 ts_tablet_manager.cc:1397] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 12:40:15.381544 6079 raft_consensus.cc:348] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.381987 6079 raft_consensus.cc:374] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:15.382176 6079 raft_consensus.cc:729] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196edbf161044099bb4b645e96a94c4e, State: Initialized, Role: FOLLOWER
I20260811 12:40:15.382815 6055 heartbeater.cc:503] Master 127.0.186.126:43323 was elected leader, sending a full tablet report...
I20260811 12:40:15.383033 6079 consensus_queue.cc:260] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.384212 5896 heartbeater.cc:503] Master 127.0.186.126:43323 was elected leader, sending a full tablet report...
I20260811 12:40:15.385288 6076 ts_tablet_manager.cc:1428] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Time spent starting tablet: real 0.021s user 0.014s sys 0.004s
I20260811 12:40:15.386691 6079 ts_tablet_manager.cc:1428] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Time spent starting tablet: real 0.015s user 0.008s sys 0.004s
I20260811 12:40:15.389693 6077 raft_consensus.cc:348] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.390393 6077 raft_consensus.cc:374] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:15.390527 6077 raft_consensus.cc:729] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf603cbea564824a81cab012fc8afba, State: Initialized, Role: FOLLOWER
I20260811 12:40:15.391276 6077 consensus_queue.cc:260] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.392943 6077 ts_tablet_manager.cc:1428] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260811 12:40:15.416707 5897 tablet.cc:2369] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:40:15.485024 6056 tablet.cc:2369] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:40:15.614275 5740 tablet.cc:2369] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:15.621217 6084 raft_consensus.cc:482] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:15.621682 6084 raft_consensus.cc:504] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.623466 6084 leader_election.cc:288] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196edbf161044099bb4b645e96a94c4e (127.0.186.66:46259), 3633e0a056bc4eb5b7cae137fd803348 (127.0.186.67:42651)
I20260811 12:40:15.633446 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.624035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:39603 (local address 127.0.186.67:42651)
0811 12:40:15.624254 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.624261 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.625077 (+ 816us) server_negotiation.cc:407] Connection header received
0811 12:40:15.625303 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.625308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.625392 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.625502 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:15.626406 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.627619 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.630774 (+ 3155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.632069 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.632246 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.632323 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.632992 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.633221 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:40:15.633420 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.624040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:43497 (local address 127.0.186.66:46259)
0811 12:40:15.624254 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.624261 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.625077 (+ 816us) server_negotiation.cc:407] Connection header received
0811 12:40:15.625302 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.625308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.625392 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.625502 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:15.626485 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.627589 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.630774 (+ 3185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.632064 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.632244 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.632323 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.632992 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.633142 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:40:15.633723 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.623917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:46259 (local address 127.0.186.65:43497)
0811 12:40:15.624945 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:15.624966 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:15.625148 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:15.625544 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:15.625549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:15.625589 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:15.626272 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.626286 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.627763 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.627769 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.630558 (+ 2789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.630575 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.632384 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.632391 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.632695 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.632829 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 12:40:15.632933 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 12:40:15.633166 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":238,"spinlock_wait_cycles":22272,"thread_start_us":549,"threads_started":1}
I20260811 12:40:15.633744 6086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.623841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:42651 (local address 127.0.186.65:39603)
0811 12:40:15.624920 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:15.624946 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:15.625118 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:15.625544 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:15.625549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:15.625611 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:15.626162 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.626184 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.627765 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.627769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.630558 (+ 2789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:15.630575 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.632396 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.632401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:15.632691 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.632832 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 12:40:15.632933 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 12:40:15.633180 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":374,"spinlock_wait_cycles":34176,"thread_start_us":641,"threads_started":1}
I20260811 12:40:15.635255 5994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d88313f02245d3b7fc45d931e42f1e" candidate_uuid: "dbf603cbea564824a81cab012fc8afba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3633e0a056bc4eb5b7cae137fd803348" is_pre_election: true
I20260811 12:40:15.635255 5840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d88313f02245d3b7fc45d931e42f1e" candidate_uuid: "dbf603cbea564824a81cab012fc8afba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196edbf161044099bb4b645e96a94c4e" is_pre_election: true
I20260811 12:40:15.635915 5994 raft_consensus.cc:2454] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf603cbea564824a81cab012fc8afba in term 0.
I20260811 12:40:15.635903 5840 raft_consensus.cc:2454] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbf603cbea564824a81cab012fc8afba in term 0.
I20260811 12:40:15.636759 5606 leader_election.cc:302] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 196edbf161044099bb4b645e96a94c4e, 3633e0a056bc4eb5b7cae137fd803348, dbf603cbea564824a81cab012fc8afba; no voters:
I20260811 12:40:15.637358 6084 raft_consensus.cc:2781] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:15.637545 6084 raft_consensus.cc:482] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:15.637673 6084 raft_consensus.cc:3037] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:15.640002 6084 raft_consensus.cc:504] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.640671 6084 leader_election.cc:288] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [CANDIDATE]: Term 1 election: Requested vote from peers 196edbf161044099bb4b645e96a94c4e (127.0.186.66:46259), 3633e0a056bc4eb5b7cae137fd803348 (127.0.186.67:42651)
I20260811 12:40:15.641243 5994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d88313f02245d3b7fc45d931e42f1e" candidate_uuid: "dbf603cbea564824a81cab012fc8afba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3633e0a056bc4eb5b7cae137fd803348"
I20260811 12:40:15.641287 5840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d88313f02245d3b7fc45d931e42f1e" candidate_uuid: "dbf603cbea564824a81cab012fc8afba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196edbf161044099bb4b645e96a94c4e"
I20260811 12:40:15.641491 5994 raft_consensus.cc:3037] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:15.641506 5840 raft_consensus.cc:3037] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:15.643779 5994 raft_consensus.cc:2454] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf603cbea564824a81cab012fc8afba in term 1.
I20260811 12:40:15.643826 5840 raft_consensus.cc:2454] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbf603cbea564824a81cab012fc8afba in term 1.
I20260811 12:40:15.644335 5606 leader_election.cc:302] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 196edbf161044099bb4b645e96a94c4e, 3633e0a056bc4eb5b7cae137fd803348, dbf603cbea564824a81cab012fc8afba; no voters:
I20260811 12:40:15.644690 6084 raft_consensus.cc:2781] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:15.645355 6084 raft_consensus.cc:686] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 1 LEADER]: Becoming Leader. State: Replica: dbf603cbea564824a81cab012fc8afba, State: Running, Role: LEADER
I20260811 12:40:15.645912 6084 consensus_queue.cc:237] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } }
I20260811 12:40:15.650748 5516 catalog_manager.cc:5495] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba reported cstate change: term changed from 0 to 1, leader changed from <none> to dbf603cbea564824a81cab012fc8afba (127.0.186.65). New cstate: current_term: 1 leader_uuid: "dbf603cbea564824a81cab012fc8afba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbf603cbea564824a81cab012fc8afba" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 34681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:15.694530 6074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.689241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.0.186.65:34681)
0811 12:40:15.689450 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.689455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.689474 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:40:15.689610 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.689614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.689695 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.689820 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:15.690160 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.690906 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.692252 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.692663 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.692835 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.693290 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:15.693824 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:15.693944 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.694144 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.694215 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 12:40:15.703362 5840 raft_consensus.cc:1261] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 1 FOLLOWER]: Refusing update from remote peer dbf603cbea564824a81cab012fc8afba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:15.703358 5994 raft_consensus.cc:1261] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 1 FOLLOWER]: Refusing update from remote peer dbf603cbea564824a81cab012fc8afba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:15.704491 6087 consensus_queue.cc:1035] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3633e0a056bc4eb5b7cae137fd803348" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:15.704892 6084 consensus_queue.cc:1035] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [LEADER]: Connected to new peer: Peer: permanent_uuid: "196edbf161044099bb4b645e96a94c4e" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:15.717338 6090 mvcc.cc:205] Tried to move back new op lower bound from 7317307456309907456 to 7317307456089952256. Current Snapshot: MvccSnapshot[applied={T|T < 7317307456309907456}]
I20260811 12:40:15.737073 5516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:15.737377 5516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:15.741355 5516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3736c09c26fa47fa8e8f3a1a27cab25f: Sending DeleteTablet for 3 replicas of tablet b7d88313f02245d3b7fc45d931e42f1e
I20260811 12:40:15.742759 5967 tablet_service.cc:1514] Processing DeleteTablet for tablet b7d88313f02245d3b7fc45d931e42f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:15 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:47858
I20260811 12:40:15.743053 5657 tablet_service.cc:1514] Processing DeleteTablet for tablet b7d88313f02245d3b7fc45d931e42f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:15 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:46568
I20260811 12:40:15.743098 5816 tablet_service.cc:1514] Processing DeleteTablet for tablet b7d88313f02245d3b7fc45d931e42f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:15 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:58372
I20260811 12:40:15.744802 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 5585
I20260811 12:40:15.755981 6100 tablet_replica.cc:330] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: stopping tablet replica
I20260811 12:40:15.756062 6101 tablet_replica.cc:330] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: stopping tablet replica
I20260811 12:40:15.756548 6100 raft_consensus.cc:2229] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:15.756789 6103 tablet_replica.cc:330] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: stopping tablet replica
I20260811 12:40:15.756924 6101 raft_consensus.cc:2229] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:15.757205 6100 raft_consensus.cc:2258] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:15.757231 6103 raft_consensus.cc:2229] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:15.757731 6103 raft_consensus.cc:2258] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:15.758097 6101 raft_consensus.cc:2258] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:15.760481 6100 ts_tablet_manager.cc:1905] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:15.760573 6101 ts_tablet_manager.cc:1905] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:15.761785 6103 ts_tablet_manager.cc:1905] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:15.768465 6100 ts_tablet_manager.cc:1918] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:15.768682 6100 log.cc:1196] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/b7d88313f02245d3b7fc45d931e42f1e
I20260811 12:40:15.769327 6100 ts_tablet_manager.cc:1939] T b7d88313f02245d3b7fc45d931e42f1e P 3633e0a056bc4eb5b7cae137fd803348: Deleting consensus metadata
I20260811 12:40:15.769630 6103 ts_tablet_manager.cc:1918] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:15.769904 6103 log.cc:1196] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/b7d88313f02245d3b7fc45d931e42f1e
I20260811 12:40:15.770886 6103 ts_tablet_manager.cc:1939] T b7d88313f02245d3b7fc45d931e42f1e P 196edbf161044099bb4b645e96a94c4e: Deleting consensus metadata
I20260811 12:40:15.771346 5499 catalog_manager.cc:4841] TS 3633e0a056bc4eb5b7cae137fd803348 (127.0.186.67:42651): tablet b7d88313f02245d3b7fc45d931e42f1e (table test-table [id=791ae6f5096548ec923370367de65a93]) successfully deleted
I20260811 12:40:15.772895 5497 catalog_manager.cc:4841] TS 196edbf161044099bb4b645e96a94c4e (127.0.186.66:46259): tablet b7d88313f02245d3b7fc45d931e42f1e (table test-table [id=791ae6f5096548ec923370367de65a93]) successfully deleted
I20260811 12:40:15.774091 6101 ts_tablet_manager.cc:1918] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:15.774313 6101 log.cc:1196] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/b7d88313f02245d3b7fc45d931e42f1e
I20260811 12:40:15.774995 6101 ts_tablet_manager.cc:1939] T b7d88313f02245d3b7fc45d931e42f1e P dbf603cbea564824a81cab012fc8afba: Deleting consensus metadata
Aug 11 12:40:15 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:15.776517 5497 catalog_manager.cc:4841] TS dbf603cbea564824a81cab012fc8afba (127.0.186.65:34681): tablet b7d88313f02245d3b7fc45d931e42f1e (table test-table [id=791ae6f5096548ec923370367de65a93]) successfully deleted
I20260811 12:40:15.782992 6074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.746362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46594 (local address 127.0.186.65:34681)
0811 12:40:15.746605 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.746614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.756334 (+ 9720us) server_negotiation.cc:407] Connection header received
0811 12:40:15.756672 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.756678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.756807 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.756908 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:15.760338 (+ 3430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.761582 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.768196 (+ 6614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.769024 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.769149 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.776333 (+ 7184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:15.776349 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:15.776367 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:15.776430 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:15.779834 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.780847 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.780853 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.780856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.781010 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.781469 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.781472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.781474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.781833 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:15.782076 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.782451 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.782648 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:40:15.783691 5732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:15.886360 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 5585
I20260811 12:40:15.910328 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 5745
Aug 11 12:40:15 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:40:15.926191 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:15.911224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58388 (local address 127.0.186.66:46259)
0811 12:40:15.911461 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:15.911466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:15.911486 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:40:15.911678 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:15.911684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:15.911778 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:15.911874 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:15.913314 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.914071 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.915333 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:15.915738 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:15.915834 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:15.920162 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:15.920181 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:15.920198 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:15.920233 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:15.923319 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.923986 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.923994 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.923997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.924160 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:15.924503 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:15.924506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:15.924508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:15.924982 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:15.925216 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:15.925572 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 12:40:15.925768 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 12:40:15.926880 5891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:16.023295 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 5745
I20260811 12:40:16.045845 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 5902
Aug 11 12:40:16 dist-test-slave-qg60 krb5kdc[5463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:40:16.062204 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:16.046840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47862 (local address 127.0.186.67:42651)
0811 12:40:16.047046 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:16.047051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:16.047079 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:40:16.047183 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:16.047188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:16.047252 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:16.047338 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:16.048654 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:16.049488 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:16.050785 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:16.051235 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:16.051337 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:16.055982 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:16.056000 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:16.056017 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:16.056092 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:16.059153 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:16.059932 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:16.059939 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:16.059941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:16.060127 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:16.060470 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:16.060473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:16.060475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:16.060989 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:16.061260 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:16.061573 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 12:40:16.061748 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 12:40:16.062906 6050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:16.156350 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 5902
I20260811 12:40:16.181154 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 5479
I20260811 12:40:16.182370 5554 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:16.298211 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 5479
2026-08-11T12:40:16Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4861 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T12:40:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:16Z Disabled control of system clock
I20260811 12:40:16.386998 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39697
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 12:40:16.779136 6113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:16.779443 6113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:16.779605 6113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:16.787439 6113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:16.787592 6113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:16.787662 6113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:16.787760 6113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:16.787835 6113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:16.797753 6113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39697
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:16.799181 6113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:16.801221 6113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:16.813571 6118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:16.813613 6119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:16.813671 6121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:16.815083 6113 server_base.cc:1034] running on GCE node
I20260811 12:40:16.815908 6113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:16.817458 6113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:16.818701 6113 hybrid_clock.cc:648] HybridClock initialized: now 1786452016818657 us; error 56 us; skew 500 ppm
I20260811 12:40:16.819053 6113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:16.821527 6113 webserver.cc:460] Webserver started at http://127.0.186.126:33341/ using document root <none> and password file <none>
I20260811 12:40:16.822245 6113 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:16.822382 6113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:16.822745 6113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:16.825871 6113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "c333697ab61644dca04116dda0ed96e2"
format_stamp: "Formatted at 2026-08-11 12:40:16 on dist-test-slave-qg60"
server_key: "e1fe4537b6f14a7781b0e6d05ab1f029"
server_key_iv: "2f69ad4011b8105e1b008f5802408eb3"
server_key_version: "encryptionkey@0"
I20260811 12:40:16.826737 6113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "c333697ab61644dca04116dda0ed96e2"
format_stamp: "Formatted at 2026-08-11 12:40:16 on dist-test-slave-qg60"
server_key: "e1fe4537b6f14a7781b0e6d05ab1f029"
server_key_iv: "2f69ad4011b8105e1b008f5802408eb3"
server_key_version: "encryptionkey@0"
I20260811 12:40:16.832521 6113 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:40:16.836638 6128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:16.838228 6113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:16.838436 6113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "c333697ab61644dca04116dda0ed96e2"
format_stamp: "Formatted at 2026-08-11 12:40:16 on dist-test-slave-qg60"
server_key: "e1fe4537b6f14a7781b0e6d05ab1f029"
server_key_iv: "2f69ad4011b8105e1b008f5802408eb3"
server_key_version: "encryptionkey@0"
I20260811 12:40:16.838689 6113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:16.845432 6113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:16.846387 6113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:16.846771 6113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:16.867712 6113 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39697
I20260811 12:40:16.867730 6188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39697 every 8 connection(s)
I20260811 12:40:16.869424 6113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:16.873446 6189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:16.878129 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6113
I20260811 12:40:16.878347 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:16.879025 745 external_mini_cluster.cc:1428] Setting key cbd46f1d9cdb605dab9accfa709bda03
I20260811 12:40:16.886344 6189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2: Bootstrap starting.
I20260811 12:40:16.889335 6192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:16.881280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40592 (local address 127.0.186.126:39697)
0811 12:40:16.882490 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:16.882509 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:16.882572 (+ 63us) server_negotiation.cc:407] Connection header received
0811 12:40:16.885110 (+ 2538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:16.885139 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:16.885701 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:16.886155 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:16.887208 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:16.887216 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:16.887231 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:16.887249 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:16.887324 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:16.887346 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:16.887576 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:16.887708 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 12:40:16.887977 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":376,"threads_started":1}
I20260811 12:40:16.890600 6189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:16.891683 6189 log.cc:824] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:16.894584 6189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2: No bootstrap required, opened a new log
I20260811 12:40:16.902261 6189 raft_consensus.cc:348] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c333697ab61644dca04116dda0ed96e2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39697 } }
I20260811 12:40:16.902649 6189 raft_consensus.cc:374] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:16.902758 6189 raft_consensus.cc:729] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c333697ab61644dca04116dda0ed96e2, State: Initialized, Role: FOLLOWER
I20260811 12:40:16.903395 6189 consensus_queue.cc:260] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c333697ab61644dca04116dda0ed96e2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39697 } }
I20260811 12:40:16.903658 6189 raft_consensus.cc:388] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:16.903802 6189 raft_consensus.cc:482] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:16.903988 6189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:16.906272 6189 raft_consensus.cc:504] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c333697ab61644dca04116dda0ed96e2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39697 } }
I20260811 12:40:16.906776 6189 leader_election.cc:302] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c333697ab61644dca04116dda0ed96e2; no voters:
I20260811 12:40:16.907449 6189 leader_election.cc:288] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:16.907546 6194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:16.908368 6194 raft_consensus.cc:686] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [term 1 LEADER]: Becoming Leader. State: Replica: c333697ab61644dca04116dda0ed96e2, State: Running, Role: LEADER
I20260811 12:40:16.909086 6194 consensus_queue.cc:237] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c333697ab61644dca04116dda0ed96e2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39697 } }
I20260811 12:40:16.909898 6189 sys_catalog.cc:564] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:16.912060 6195 sys_catalog.cc:455] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c333697ab61644dca04116dda0ed96e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c333697ab61644dca04116dda0ed96e2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39697 } } }
I20260811 12:40:16.912444 6195 sys_catalog.cc:458] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:16.913091 6197 sys_catalog.cc:455] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c333697ab61644dca04116dda0ed96e2. Latest consensus state: current_term: 1 leader_uuid: "c333697ab61644dca04116dda0ed96e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c333697ab61644dca04116dda0ed96e2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39697 } } }
I20260811 12:40:16.913502 6197 sys_catalog.cc:458] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:16.926378 6203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:16.932049 6203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:16.941586 6203 catalog_manager.cc:1347] Generated new cluster ID: 9b5aa15f527d42039e7bb955aa8fab65
I20260811 12:40:16.941761 6203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:16.966495 6203 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:16.967092 6203 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:16.980320 6203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2: Generated new TSK 0
I20260811 12:40:16.981526 6203 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:40:16.999176 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39697
--builtin_ntp_servers=127.0.186.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 12:40:17.360877 6216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:17.361194 6216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:17.361377 6216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:17.369006 6216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:17.369117 6216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:17.369290 6216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:17.378834 6216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:17.380285 6216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:17.382253 6216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:17.396798 6222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:17.396854 6221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:17.396907 6224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:17.397970 6216 server_base.cc:1034] running on GCE node
I20260811 12:40:17.398669 6216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:17.399705 6216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:17.400903 6216 hybrid_clock.cc:648] HybridClock initialized: now 1786452017400854 us; error 35 us; skew 500 ppm
I20260811 12:40:17.401257 6216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:17.403644 6216 webserver.cc:460] Webserver started at http://127.0.186.65:41223/ using document root <none> and password file <none>
I20260811 12:40:17.404418 6216 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:17.404551 6216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:17.404968 6216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:17.408054 6216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "7be5755a495f427a816fd8ee094d65ae"
format_stamp: "Formatted at 2026-08-11 12:40:17 on dist-test-slave-qg60"
server_key: "1bf812f375fbada29d7dd7669f2378a0"
server_key_iv: "7d9bf876706cd52a088cf9e53b2d38f6"
server_key_version: "encryptionkey@0"
I20260811 12:40:17.409049 6216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "7be5755a495f427a816fd8ee094d65ae"
format_stamp: "Formatted at 2026-08-11 12:40:17 on dist-test-slave-qg60"
server_key: "1bf812f375fbada29d7dd7669f2378a0"
server_key_iv: "7d9bf876706cd52a088cf9e53b2d38f6"
server_key_version: "encryptionkey@0"
I20260811 12:40:17.415164 6216 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 12:40:17.419001 6232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:17.420554 6216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:40:17.420781 6216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "7be5755a495f427a816fd8ee094d65ae"
format_stamp: "Formatted at 2026-08-11 12:40:17 on dist-test-slave-qg60"
server_key: "1bf812f375fbada29d7dd7669f2378a0"
server_key_iv: "7d9bf876706cd52a088cf9e53b2d38f6"
server_key_version: "encryptionkey@0"
I20260811 12:40:17.421068 6216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:17.427670 6216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:17.428496 6216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:17.428805 6216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:17.429764 6216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:17.431263 6216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:17.431356 6216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:17.431444 6216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:17.431501 6216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:17.468321 6216 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:46785
I20260811 12:40:17.468420 6361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:46785 every 8 connection(s)
I20260811 12:40:17.469808 6216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:17.478482 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6216
I20260811 12:40:17.478721 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:17.479176 6364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:17.472817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:54209 (local address 127.0.186.126:39697)
0811 12:40:17.473323 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:17.473328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:17.474602 (+ 1274us) server_negotiation.cc:407] Connection header received
0811 12:40:17.476532 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:17.476538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:17.476616 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:17.476772 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:17.478241 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:17.478247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:17.478252 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:17.478274 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:17.478327 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:17.478340 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:17.478492 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:17.478731 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 12:40:17.478812 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":256,"threads_started":1}
I20260811 12:40:17.479655 745 external_mini_cluster.cc:1428] Setting key 31d238d95fd18788b757fd4cb509528a
I20260811 12:40:17.480229 6365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:17.473463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39697 (local address 127.0.186.65:54209)
0811 12:40:17.474424 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:17.474469 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:17.476182 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:17.477048 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:17.477056 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:17.477158 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:17.477911 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:17.477914 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:17.477952 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:17.478041 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:17.478446 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:17.478460 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:17.478470 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 12:40:17.478823 (+ 353us) client_negotiation.cc:240] Negotiation successful
0811 12:40:17.479099 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":279,"threads_started":1}
I20260811 12:40:17.482117 6362 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39697
I20260811 12:40:17.482445 6362 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:17.482887 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39697
--builtin_ntp_servers=127.0.186.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 12:40:17.483151 6362 heartbeater.cc:511] Master 127.0.186.126:39697 requested a full tablet report, sending...
I20260811 12:40:17.485656 6149 ts_manager.cc:194] Registered new tserver with Master: 7be5755a495f427a816fd8ee094d65ae (127.0.186.65:46785)
W20260811 12:40:17.839416 6366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:17.839721 6366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:17.839874 6366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:17.847756 6366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:17.847879 6366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:17.848078 6366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:17.858151 6366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:17.859598 6366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:17.861594 6366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:17.877406 6372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:17.877589 6373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:17.878343 6375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:17.879184 6366 server_base.cc:1034] running on GCE node
I20260811 12:40:17.879860 6366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:17.880983 6366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:17.882241 6366 hybrid_clock.cc:648] HybridClock initialized: now 1786452017882169 us; error 63 us; skew 500 ppm
I20260811 12:40:17.882596 6366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:17.885126 6366 webserver.cc:460] Webserver started at http://127.0.186.66:33511/ using document root <none> and password file <none>
I20260811 12:40:17.885869 6366 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:17.886018 6366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:17.886366 6366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:17.889453 6366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "01f482065e214cbaa97ba4e0befdf4e0"
format_stamp: "Formatted at 2026-08-11 12:40:17 on dist-test-slave-qg60"
server_key: "5c1bf04efb4fbc2fb7d7a82981c9c30a"
server_key_iv: "aaa8325f1119286851570913158b3c6d"
server_key_version: "encryptionkey@0"
I20260811 12:40:17.890323 6366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "01f482065e214cbaa97ba4e0befdf4e0"
format_stamp: "Formatted at 2026-08-11 12:40:17 on dist-test-slave-qg60"
server_key: "5c1bf04efb4fbc2fb7d7a82981c9c30a"
server_key_iv: "aaa8325f1119286851570913158b3c6d"
server_key_version: "encryptionkey@0"
I20260811 12:40:17.895620 6366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 12:40:17.899312 6382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:17.900902 6366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 12:40:17.901117 6366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "01f482065e214cbaa97ba4e0befdf4e0"
format_stamp: "Formatted at 2026-08-11 12:40:17 on dist-test-slave-qg60"
server_key: "5c1bf04efb4fbc2fb7d7a82981c9c30a"
server_key_iv: "aaa8325f1119286851570913158b3c6d"
server_key_version: "encryptionkey@0"
I20260811 12:40:17.901374 6366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:17.907325 6366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:17.908192 6366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:17.908488 6366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:17.909674 6366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:17.911369 6366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:17.911497 6366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:17.911644 6366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:17.911736 6366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:17.948946 6366 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:37139
I20260811 12:40:17.949016 6513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:37139 every 8 connection(s)
I20260811 12:40:17.950443 6366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:17.959367 6364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:17.953453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:41845 (local address 127.0.186.126:39697)
0811 12:40:17.953702 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:17.953709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:17.955228 (+ 1519us) server_negotiation.cc:407] Connection header received
0811 12:40:17.957039 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:17.957043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:17.957130 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:17.957227 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:17.958687 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:17.958692 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:17.958696 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:17.958714 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:17.958749 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:17.958761 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:17.958882 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:17.959051 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 12:40:17.959140 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 12:40:17.960541 6516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:17.953998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39697 (local address 127.0.186.66:41845)
0811 12:40:17.955032 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:17.955094 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:17.956695 (+ 1601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:17.957483 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:17.957492 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:17.957588 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:17.958373 (+ 785us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:17.958375 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:17.958415 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:17.958503 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:17.958859 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:17.958868 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:17.958873 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 12:40:17.959106 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 12:40:17.959349 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":306,"threads_started":1}
I20260811 12:40:17.960592 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6366
I20260811 12:40:17.960790 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:17.961308 745 external_mini_cluster.cc:1428] Setting key 7631da64d16596059dfd8203abe3e920
I20260811 12:40:17.962227 6514 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39697
I20260811 12:40:17.962577 6514 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:17.963320 6514 heartbeater.cc:511] Master 127.0.186.126:39697 requested a full tablet report, sending...
I20260811 12:40:17.964576 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39697
--builtin_ntp_servers=127.0.186.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 12:40:17.965029 6149 ts_manager.cc:194] Registered new tserver with Master: 01f482065e214cbaa97ba4e0befdf4e0 (127.0.186.66:37139)
W20260811 12:40:18.314210 6517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:18.314536 6517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:18.314713 6517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:18.322413 6517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:18.322533 6517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:18.322717 6517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:18.332545 6517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:18.334168 6517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:18.336164 6517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:18.350677 6525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:18.350780 6527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:18.350780 6524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:18.351547 6517 server_base.cc:1034] running on GCE node
I20260811 12:40:18.352173 6517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:18.353322 6517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:18.354545 6517 hybrid_clock.cc:648] HybridClock initialized: now 1786452018354477 us; error 62 us; skew 500 ppm
I20260811 12:40:18.354913 6517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:18.357425 6517 webserver.cc:460] Webserver started at http://127.0.186.67:45357/ using document root <none> and password file <none>
I20260811 12:40:18.358196 6517 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:18.358325 6517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:18.358714 6517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:18.362156 6517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "a16f42fc355b4d33aefd08994e1168d9"
format_stamp: "Formatted at 2026-08-11 12:40:18 on dist-test-slave-qg60"
server_key: "7744d8eecefc6393c6ac9df7d842eae1"
server_key_iv: "c16fc62f4726abf86e3dd564f37ccf3c"
server_key_version: "encryptionkey@0"
I20260811 12:40:18.363046 6517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "a16f42fc355b4d33aefd08994e1168d9"
format_stamp: "Formatted at 2026-08-11 12:40:18 on dist-test-slave-qg60"
server_key: "7744d8eecefc6393c6ac9df7d842eae1"
server_key_iv: "c16fc62f4726abf86e3dd564f37ccf3c"
server_key_version: "encryptionkey@0"
I20260811 12:40:18.369200 6517 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 12:40:18.373085 6535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:18.374544 6517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:18.374745 6517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "a16f42fc355b4d33aefd08994e1168d9"
format_stamp: "Formatted at 2026-08-11 12:40:18 on dist-test-slave-qg60"
server_key: "7744d8eecefc6393c6ac9df7d842eae1"
server_key_iv: "c16fc62f4726abf86e3dd564f37ccf3c"
server_key_version: "encryptionkey@0"
I20260811 12:40:18.375012 6517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:18.381132 6517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:18.381978 6517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:18.382277 6517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:18.383252 6517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:18.384859 6517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:18.384980 6517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:18.385128 6517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:18.385226 6517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:18.422326 6517 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:37873
I20260811 12:40:18.422389 6665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:37873 every 8 connection(s)
I20260811 12:40:18.423851 6517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:18.432093 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6517
I20260811 12:40:18.432293 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:18.432905 745 external_mini_cluster.cc:1428] Setting key 5d6ef2c4e4d649b9ec86b7ddf268c0cb
I20260811 12:40:18.433075 6364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.426721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:33499 (local address 127.0.186.126:39697)
0811 12:40:18.426928 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.426932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.428360 (+ 1428us) server_negotiation.cc:407] Connection header received
0811 12:40:18.430231 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.430235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.430291 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.430379 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.432090 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.432095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.432100 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.432124 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.432174 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.432194 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.432366 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.432650 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.432745 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:40:18.434725 6669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.427289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39697 (local address 127.0.186.67:33499)
0811 12:40:18.428208 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.428244 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:18.429965 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:18.430590 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:18.430598 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:18.430711 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:18.431708 (+ 997us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:18.431711 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:18.431753 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:18.431841 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:18.432400 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:18.432416 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:18.432424 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 12:40:18.432943 (+ 519us) client_negotiation.cc:240] Negotiation successful
0811 12:40:18.433346 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":273,"threads_started":1}
I20260811 12:40:18.436231 6666 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39697
I20260811 12:40:18.436674 6666 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:18.437364 6666 heartbeater.cc:511] Master 127.0.186.126:39697 requested a full tablet report, sending...
I20260811 12:40:18.438845 6149 ts_manager.cc:194] Registered new tserver with Master: a16f42fc355b4d33aefd08994e1168d9 (127.0.186.67:37873)
I20260811 12:40:18.449419 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:40:18.457180 6364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.454413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.0.186.126:39697)
0811 12:40:18.454600 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.454604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.455074 (+ 470us) server_negotiation.cc:407] Connection header received
0811 12:40:18.455261 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.455265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.455322 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.455412 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.456460 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.456465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.456468 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.456484 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.456528 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.456540 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.456650 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.456892 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.456956 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 12:40:18.461629 6149 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:18.469023 6149 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:18.488526 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.482755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48576 (local address 127.0.186.66:37139)
0811 12:40:18.483451 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.483460 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.484265 (+ 805us) server_negotiation.cc:407] Connection header received
0811 12:40:18.484489 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.484500 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.484803 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.484971 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.487589 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.487601 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.487615 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.487637 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.487715 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.487742 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.487888 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.488038 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.488159 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":329,"threads_started":1}
I20260811 12:40:18.488719 6685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.482518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:37139 (local address 127.0.0.1:48576)
0811 12:40:18.484059 (+ 1541us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.484123 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:18.484321 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:18.486122 (+ 1801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:18.486129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:18.486162 (+ 33us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:18.487292 (+ 1130us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:18.487295 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:18.487319 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:18.487387 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:18.487848 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:18.487859 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:18.487867 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 12:40:18.488062 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 12:40:18.488161 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1186,"thread_start_us":2090,"threads_started":1}
I20260811 12:40:18.488957 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.482818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54010)
0811 12:40:18.484928 (+ 2110us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.484946 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:18.485048 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:18.485833 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:18.485841 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:18.485931 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:18.487569 (+ 1638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:18.487571 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:18.487581 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:18.487650 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:18.488227 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:18.488231 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:18.488236 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 12:40:18.488381 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 12:40:18.488430 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1971,"thread_start_us":917,"threads_started":1}
I20260811 12:40:18.489178 6362 heartbeater.cc:503] Master 127.0.186.126:39697 was elected leader, sending a full tablet report...
I20260811 12:40:18.489717 6686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.483551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54010 (local address 127.0.186.65:46785)
0811 12:40:18.484125 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.484133 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.485193 (+ 1060us) server_negotiation.cc:407] Connection header received
0811 12:40:18.485280 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.485288 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.485488 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.485643 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.487848 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.487857 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.487870 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.487891 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.487962 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.487988 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.488161 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.489197 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.489305 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":2107,"threads_started":1}
I20260811 12:40:18.493306 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.484698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:37873 (local address 127.0.0.1:44920)
0811 12:40:18.487506 (+ 2808us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.487533 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:18.487654 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:18.490837 (+ 3183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:18.490842 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:18.490871 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:18.491681 (+ 810us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:18.491685 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:18.491703 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:18.491758 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:18.492592 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:18.492596 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:18.492602 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 12:40:18.492775 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 12:40:18.492836 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2518,"thread_start_us":2311,"threads_started":1}
I20260811 12:40:18.494117 6688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.485306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44920 (local address 127.0.186.67:37873)
0811 12:40:18.486805 (+ 1499us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.486814 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.487665 (+ 851us) server_negotiation.cc:407] Connection header received
0811 12:40:18.489360 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.489369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.489576 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.489732 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.491983 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.491992 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.492005 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.492026 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.492223 (+ 197us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.492259 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.492521 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.493631 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.493735 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1275,"thread_start_us":1085,"threads_started":1}
I20260811 12:40:18.494241 6288 tablet_service.cc:1467] Processing CreateTablet for tablet 9504c21250ce446f8ecd19657dfd2635 (DEFAULT_TABLE table=test-table [id=7745fcb4a5184f209524df438fbb90ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:18.494455 6439 tablet_service.cc:1467] Processing CreateTablet for tablet 9504c21250ce446f8ecd19657dfd2635 (DEFAULT_TABLE table=test-table [id=7745fcb4a5184f209524df438fbb90ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:18.495769 6288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9504c21250ce446f8ecd19657dfd2635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:18.495819 6439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9504c21250ce446f8ecd19657dfd2635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:18.498059 6588 tablet_service.cc:1467] Processing CreateTablet for tablet 9504c21250ce446f8ecd19657dfd2635 (DEFAULT_TABLE table=test-table [id=7745fcb4a5184f209524df438fbb90ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:18.499569 6588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9504c21250ce446f8ecd19657dfd2635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:18.509865 6689 tablet_bootstrap.cc:492] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Bootstrap starting.
I20260811 12:40:18.513551 6690 tablet_bootstrap.cc:492] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: Bootstrap starting.
I20260811 12:40:18.513686 6689 tablet_bootstrap.cc:654] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:18.515476 6691 tablet_bootstrap.cc:492] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Bootstrap starting.
I20260811 12:40:18.516542 6689 log.cc:824] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:18.517620 6690 tablet_bootstrap.cc:654] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:18.518841 6691 tablet_bootstrap.cc:654] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:18.518997 6690 log.cc:824] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:18.520076 6689 tablet_bootstrap.cc:492] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: No bootstrap required, opened a new log
I20260811 12:40:18.520174 6691 log.cc:824] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:18.520406 6689 ts_tablet_manager.cc:1397] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260811 12:40:18.522169 6690 tablet_bootstrap.cc:492] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: No bootstrap required, opened a new log
I20260811 12:40:18.522475 6690 ts_tablet_manager.cc:1397] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 12:40:18.523869 6691 tablet_bootstrap.cc:492] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: No bootstrap required, opened a new log
I20260811 12:40:18.524179 6691 ts_tablet_manager.cc:1397] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 12:40:18.529345 6689 raft_consensus.cc:348] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.529789 6689 raft_consensus.cc:374] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:18.529930 6689 raft_consensus.cc:729] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f482065e214cbaa97ba4e0befdf4e0, State: Initialized, Role: FOLLOWER
I20260811 12:40:18.530622 6689 consensus_queue.cc:260] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.531808 6514 heartbeater.cc:503] Master 127.0.186.126:39697 was elected leader, sending a full tablet report...
I20260811 12:40:18.533953 6689 ts_tablet_manager.cc:1428] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260811 12:40:18.533680 6690 raft_consensus.cc:348] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.534300 6690 raft_consensus.cc:374] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:18.534464 6690 raft_consensus.cc:729] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be5755a495f427a816fd8ee094d65ae, State: Initialized, Role: FOLLOWER
I20260811 12:40:18.535153 6690 consensus_queue.cc:260] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.535169 6691 raft_consensus.cc:348] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.535652 6691 raft_consensus.cc:374] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:18.535826 6691 raft_consensus.cc:729] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a16f42fc355b4d33aefd08994e1168d9, State: Initialized, Role: FOLLOWER
I20260811 12:40:18.536852 6691 consensus_queue.cc:260] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.538429 6690 ts_tablet_manager.cc:1428] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260811 12:40:18.540829 6666 heartbeater.cc:503] Master 127.0.186.126:39697 was elected leader, sending a full tablet report...
I20260811 12:40:18.541392 6691 ts_tablet_manager.cc:1428] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260811 12:40:18.592550 6697 raft_consensus.cc:482] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:18.592877 6697 raft_consensus.cc:504] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.594750 6697 leader_election.cc:288] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01f482065e214cbaa97ba4e0befdf4e0 (127.0.186.66:37139), a16f42fc355b4d33aefd08994e1168d9 (127.0.186.67:37873)
I20260811 12:40:18.598616 6688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.595427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:32945 (local address 127.0.186.67:37873)
0811 12:40:18.595647 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.595656 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.596387 (+ 731us) server_negotiation.cc:407] Connection header received
0811 12:40:18.596512 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.596519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.596586 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.596701 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.597902 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.597912 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.597917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.597942 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.597984 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.597999 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.598111 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.598254 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.598330 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:40:18.598752 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.595366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:42289 (local address 127.0.186.66:37139)
0811 12:40:18.595588 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.595598 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.596559 (+ 961us) server_negotiation.cc:407] Connection header received
0811 12:40:18.596734 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.596740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.596821 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.596935 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.598009 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.598013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.598016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.598032 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.598099 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.598115 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.598242 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.598386 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.598451 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 12:40:18.598910 6699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.595314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:37873 (local address 127.0.186.65:32945)
0811 12:40:18.596246 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.596270 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:18.596392 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:18.596777 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:18.596782 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:18.596807 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:18.597637 (+ 830us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:18.597642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:18.597663 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:18.597717 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:18.598105 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:18.598110 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:18.598115 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 12:40:18.598268 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 12:40:18.598348 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"thread_start_us":567,"threads_started":1}
I20260811 12:40:18.599088 6700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.595335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:37139 (local address 127.0.186.65:42289)
0811 12:40:18.596428 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.596448 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:18.596571 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:18.596973 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:18.596976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:18.596996 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:18.597775 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:40:18.597778 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:18.597818 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:40:18.597864 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:18.598241 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:18.598249 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:18.598254 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 12:40:18.598422 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 12:40:18.598472 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"thread_start_us":586,"threads_started":1}
I20260811 12:40:18.599992 6615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9504c21250ce446f8ecd19657dfd2635" candidate_uuid: "7be5755a495f427a816fd8ee094d65ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a16f42fc355b4d33aefd08994e1168d9" is_pre_election: true
I20260811 12:40:18.600253 6462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9504c21250ce446f8ecd19657dfd2635" candidate_uuid: "7be5755a495f427a816fd8ee094d65ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01f482065e214cbaa97ba4e0befdf4e0" is_pre_election: true
I20260811 12:40:18.600660 6615 raft_consensus.cc:2454] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be5755a495f427a816fd8ee094d65ae in term 0.
I20260811 12:40:18.600824 6462 raft_consensus.cc:2454] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be5755a495f427a816fd8ee094d65ae in term 0.
I20260811 12:40:18.601505 6237 leader_election.cc:302] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f482065e214cbaa97ba4e0befdf4e0, 7be5755a495f427a816fd8ee094d65ae; no voters:
I20260811 12:40:18.601950 6697 raft_consensus.cc:2781] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:18.602109 6697 raft_consensus.cc:482] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:18.602269 6697 raft_consensus.cc:3037] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:18.604799 6697 raft_consensus.cc:504] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.605652 6697 leader_election.cc:288] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [CANDIDATE]: Term 1 election: Requested vote from peers 01f482065e214cbaa97ba4e0befdf4e0 (127.0.186.66:37139), a16f42fc355b4d33aefd08994e1168d9 (127.0.186.67:37873)
I20260811 12:40:18.606154 6462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9504c21250ce446f8ecd19657dfd2635" candidate_uuid: "7be5755a495f427a816fd8ee094d65ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01f482065e214cbaa97ba4e0befdf4e0"
I20260811 12:40:18.606208 6615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9504c21250ce446f8ecd19657dfd2635" candidate_uuid: "7be5755a495f427a816fd8ee094d65ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a16f42fc355b4d33aefd08994e1168d9"
I20260811 12:40:18.606374 6462 raft_consensus.cc:3037] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:18.606453 6615 raft_consensus.cc:3037] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:18.608850 6462 raft_consensus.cc:2454] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be5755a495f427a816fd8ee094d65ae in term 1.
I20260811 12:40:18.608917 6615 raft_consensus.cc:2454] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be5755a495f427a816fd8ee094d65ae in term 1.
I20260811 12:40:18.609310 6237 leader_election.cc:302] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f482065e214cbaa97ba4e0befdf4e0, 7be5755a495f427a816fd8ee094d65ae; no voters:
I20260811 12:40:18.609644 6697 raft_consensus.cc:2781] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:18.610194 6697 raft_consensus.cc:686] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 1 LEADER]: Becoming Leader. State: Replica: 7be5755a495f427a816fd8ee094d65ae, State: Running, Role: LEADER
I20260811 12:40:18.610872 6697 consensus_queue.cc:237] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } }
I20260811 12:40:18.616084 6148 catalog_manager.cc:5495] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be5755a495f427a816fd8ee094d65ae (127.0.186.65). New cstate: current_term: 1 leader_uuid: "7be5755a495f427a816fd8ee094d65ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be5755a495f427a816fd8ee094d65ae" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:18.650789 6686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.648547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.0.186.65:46785)
0811 12:40:18.648821 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.648828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.648853 (+ 25us) server_negotiation.cc:407] Connection header received
0811 12:40:18.649020 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.649024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.649119 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.649216 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.650146 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.650151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.650154 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.650171 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.650207 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.650219 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.650329 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.650413 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.650463 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 12:40:18.660363 6615 raft_consensus.cc:1261] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 1 FOLLOWER]: Refusing update from remote peer 7be5755a495f427a816fd8ee094d65ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:18.660395 6462 raft_consensus.cc:1261] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 1 FOLLOWER]: Refusing update from remote peer 7be5755a495f427a816fd8ee094d65ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:18.661583 6701 consensus_queue.cc:1035] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "01f482065e214cbaa97ba4e0befdf4e0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 37139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:18.662050 6697 consensus_queue.cc:1035] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a16f42fc355b4d33aefd08994e1168d9" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:18.672398 6705 mvcc.cc:205] Tried to move back new op lower bound from 7317307468420702208 to 7317307468233826304. Current Snapshot: MvccSnapshot[applied={T|T < 7317307468420702208}]
I20260811 12:40:18.673719 6706 mvcc.cc:205] Tried to move back new op lower bound from 7317307468420702208 to 7317307468233826304. Current Snapshot: MvccSnapshot[applied={T|T < 7317307468420702208}]
W20260811 12:40:18.675665 6668 tablet.cc:2369] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:18.684969 6707 mvcc.cc:205] Tried to move back new op lower bound from 7317307468420702208 to 7317307468233826304. Current Snapshot: MvccSnapshot[applied={T|T < 7317307468420702208}]
I20260811 12:40:18.693434 6149 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:18.693789 6149 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:18.699563 6149 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c333697ab61644dca04116dda0ed96e2: Sending DeleteTablet for 3 replicas of tablet 9504c21250ce446f8ecd19657dfd2635
I20260811 12:40:18.700892 6439 tablet_service.cc:1514] Processing DeleteTablet for tablet 9504c21250ce446f8ecd19657dfd2635 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:18 UTC) from {username='slave'} at 127.0.0.1:48576
I20260811 12:40:18.701227 6288 tablet_service.cc:1514] Processing DeleteTablet for tablet 9504c21250ce446f8ecd19657dfd2635 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:18 UTC) from {username='slave'} at 127.0.0.1:54010
I20260811 12:40:18.701198 6588 tablet_service.cc:1514] Processing DeleteTablet for tablet 9504c21250ce446f8ecd19657dfd2635 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:18 UTC) from {username='slave'} at 127.0.0.1:44920
I20260811 12:40:18.701867 6587 tablet_service.cc:1514] Processing DeleteTablet for tablet 9504c21250ce446f8ecd19657dfd2635 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:18 UTC) from {username='slave'} at 127.0.0.1:44920
I20260811 12:40:18.703707 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6216
I20260811 12:40:18.717870 6686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.705755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54032 (local address 127.0.186.65:46785)
0811 12:40:18.705931 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.705937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.712295 (+ 6358us) server_negotiation.cc:407] Connection header received
0811 12:40:18.713579 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.713588 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.713683 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.713785 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.716357 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.716367 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.716375 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.716406 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.716462 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.716486 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.716640 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.717280 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.717378 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 12:40:18.718959 6717 tablet_replica.cc:330] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: stopping tablet replica
I20260811 12:40:18.719513 6717 raft_consensus.cc:2229] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:18.719785 6357 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:18.720151 6717 raft_consensus.cc:2258] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:18.721468 6719 tablet_replica.cc:330] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: stopping tablet replica
I20260811 12:40:18.722015 6719 raft_consensus.cc:2229] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:18.722606 6719 raft_consensus.cc:2258] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:18.724772 6717 ts_tablet_manager.cc:1905] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:18.725111 6719 ts_tablet_manager.cc:1905] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:18.732571 6717 ts_tablet_manager.cc:1918] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:18.732573 6719 ts_tablet_manager.cc:1918] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:18.732811 6717 log.cc:1196] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/9504c21250ce446f8ecd19657dfd2635
I20260811 12:40:18.732812 6719 log.cc:1196] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/9504c21250ce446f8ecd19657dfd2635
I20260811 12:40:18.733430 6717 ts_tablet_manager.cc:1939] T 9504c21250ce446f8ecd19657dfd2635 P 01f482065e214cbaa97ba4e0befdf4e0: Deleting consensus metadata
I20260811 12:40:18.733439 6719 ts_tablet_manager.cc:1939] T 9504c21250ce446f8ecd19657dfd2635 P a16f42fc355b4d33aefd08994e1168d9: Deleting consensus metadata
I20260811 12:40:18.735550 6135 catalog_manager.cc:4841] TS 01f482065e214cbaa97ba4e0befdf4e0 (127.0.186.66:37139): tablet 9504c21250ce446f8ecd19657dfd2635 (table test-table [id=7745fcb4a5184f209524df438fbb90ca]) successfully deleted
I20260811 12:40:18.735738 6129 catalog_manager.cc:4841] TS a16f42fc355b4d33aefd08994e1168d9 (127.0.186.67:37873): tablet 9504c21250ce446f8ecd19657dfd2635 (table test-table [id=7745fcb4a5184f209524df438fbb90ca]) successfully deleted
W20260811 12:40:18.736236 6129 catalog_manager.cc:4808] TS a16f42fc355b4d33aefd08994e1168d9 (127.0.186.67:37873): delete failed for tablet 9504c21250ce446f8ecd19657dfd2635 because the tablet was not found. No further retry: Not found: Tablet not found: 9504c21250ce446f8ecd19657dfd2635
I20260811 12:40:18.830281 6718 tablet_replica.cc:330] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae: stopping tablet replica
I20260811 12:40:18.830802 6718 raft_consensus.cc:2229] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:18.831499 6718 raft_consensus.cc:2258] T 9504c21250ce446f8ecd19657dfd2635 P 7be5755a495f427a816fd8ee094d65ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:18.833267 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6216
W20260811 12:40:18.858143 6129 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.186.65:46785 (error 108)
I20260811 12:40:18.858249 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6366
I20260811 12:40:18.860140 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.859670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54048)
0811 12:40:18.859856 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.859987 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 12:40:18.860438 6129 catalog_manager.cc:4584] TS 7be5755a495f427a816fd8ee094d65ae (127.0.186.65:46785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9504c21250ce446f8ecd19657dfd2635: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
I20260811 12:40:18.861641 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.859080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.0.186.66:37139)
0811 12:40:18.859286 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.859293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.859419 (+ 126us) server_negotiation.cc:407] Connection header received
0811 12:40:18.859649 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.859659 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.859752 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.859869 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.860954 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.860958 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.860961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.860978 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.861013 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.861025 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.861142 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.861287 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.861339 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:40:18.862329 6509 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:18.914072 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.913555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54050)
0811 12:40:18.913795 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.913897 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260811 12:40:18.915159 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.914786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54054)
0811 12:40:18.914947 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.915040 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 12:40:18.967585 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6366
I20260811 12:40:18.975957 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.975422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54064)
0811 12:40:18.975653 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.975770 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 12:40:18.977056 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.976689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54072)
0811 12:40:18.976865 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:18.976937 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 12:40:18.994313 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6517
I20260811 12:40:18.997491 6688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:18.995185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44934 (local address 127.0.186.67:37873)
0811 12:40:18.995379 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:18.995384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:18.995404 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:40:18.995547 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:18.995552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:18.995636 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:18.995728 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:18.996901 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:18.996907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:18.996910 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:18.996927 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:18.996960 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:18.996973 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:18.997108 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:18.997196 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 12:40:18.997248 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:40:18.998160 6661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:19.057989 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:19.057323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54078)
0811 12:40:19.057671 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:19.057802 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 12:40:19.059269 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:19.058769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54084)
0811 12:40:19.059021 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:19.059113 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 12:40:19.092314 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6517
I20260811 12:40:19.115082 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6113
I20260811 12:40:19.116464 6184 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:19.238679 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:19.237920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46785 (local address 127.0.0.1:54098)
0811 12:40:19.238238 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:19.238323 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:46785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260811 12:40:19.239519 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6113
2026-08-11T12:40:19Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2939 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 12:40:19.290540 745 mini_oidc.cc:152] Starting JWKS server
I20260811 12:40:19.293656 745 webserver.cc:460] Webserver started at https://127.0.0.1:32911/ using document root <none> and password file <none>
I20260811 12:40:19.294023 745 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 12:40:19.294723 745 webserver.cc:460] Webserver started at http://127.0.0.1:38477/ using document root <none> and password file <none>
2026-08-11T12:40:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:19Z Disabled control of system clock
I20260811 12:40:19.333720 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:36243
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:45657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:36243
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32911/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/testchainca.cert with env {}
W20260811 12:40:19.682988 6733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:19.683416 6733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:19.683601 6733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:19.691224 6733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:19.691409 6733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:19.691507 6733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:19.691610 6733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:19.691699 6733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 12:40:19.691793 6733 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 12:40:19.691874 6733 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32911/jwks.json
I20260811 12:40:19.702690 6733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:36243
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:36243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32911/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:19.704630 6733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:19.706068 6733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:19.718807 6739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:19.718842 6740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:19.719177 6742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:19.719826 6733 server_base.cc:1034] running on GCE node
I20260811 12:40:19.721020 6733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:19.722628 6733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:19.723901 6733 hybrid_clock.cc:648] HybridClock initialized: now 1786452019723847 us; error 42 us; skew 500 ppm
I20260811 12:40:19.724351 6733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:19.733610 6733 webserver.cc:460] Webserver started at http://127.0.186.126:41995/ using document root <none> and password file <none>
I20260811 12:40:19.734524 6733 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:19.734695 6733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:19.735062 6733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:19.740494 6733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "830f22273fb140e7a6412f3079020741"
format_stamp: "Formatted at 2026-08-11 12:40:19 on dist-test-slave-qg60"
server_key: "0ab86de9e1f479e02e94f2713d96a5d8"
server_key_iv: "9f8ebea6167c1453daed171b04453fe1"
server_key_version: "encryptionkey@0"
I20260811 12:40:19.741755 6733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "830f22273fb140e7a6412f3079020741"
format_stamp: "Formatted at 2026-08-11 12:40:19 on dist-test-slave-qg60"
server_key: "0ab86de9e1f479e02e94f2713d96a5d8"
server_key_iv: "9f8ebea6167c1453daed171b04453fe1"
server_key_version: "encryptionkey@0"
I20260811 12:40:19.747699 6733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 12:40:19.751430 6748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:19.752974 6733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:19.753180 6733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "830f22273fb140e7a6412f3079020741"
format_stamp: "Formatted at 2026-08-11 12:40:19 on dist-test-slave-qg60"
server_key: "0ab86de9e1f479e02e94f2713d96a5d8"
server_key_iv: "9f8ebea6167c1453daed171b04453fe1"
server_key_version: "encryptionkey@0"
I20260811 12:40:19.753420 6733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:19.783684 6733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:19.784711 6733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:19.785113 6733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:19.804777 6733 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:36243
I20260811 12:40:19.804816 6812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:36243 every 8 connection(s)
I20260811 12:40:19.806272 6733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:19.809495 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6733
I20260811 12:40:19.809737 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:19.810432 745 external_mini_cluster.cc:1428] Setting key 209247c3cbde53ca04bed85b17bc8ff2
I20260811 12:40:19.810472 6813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:19.826960 6813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741: Bootstrap starting.
I20260811 12:40:19.827178 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:19.812424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41586 (local address 127.0.186.126:36243)
0811 12:40:19.813732 (+ 1308us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:19.813748 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:19.813809 (+ 61us) server_negotiation.cc:407] Connection header received
0811 12:40:19.816040 (+ 2231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:19.816071 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:19.816706 (+ 635us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:19.817206 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:19.817797 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:19.819900 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:19.821548 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:19.822671 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:19.822872 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:19.824056 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:19.824067 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:19.824093 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:19.824954 (+ 861us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:19.825072 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:19.825100 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:19.825212 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:19.825467 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 12:40:19.825806 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":330,"threads_started":1}
I20260811 12:40:19.831158 6813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:19.831713 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:40:19.832558 6813 log.cc:824] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:19.836004 6813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741: No bootstrap required, opened a new log
I20260811 12:40:19.843945 6813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "830f22273fb140e7a6412f3079020741" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36243 } }
I20260811 12:40:19.844326 6813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:19.844406 6813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830f22273fb140e7a6412f3079020741, State: Initialized, Role: FOLLOWER
I20260811 12:40:19.845014 6813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "830f22273fb140e7a6412f3079020741" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36243 } }
I20260811 12:40:19.845230 6813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:19.845335 6813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:19.845468 6813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:19.847692 6813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "830f22273fb140e7a6412f3079020741" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36243 } }
I20260811 12:40:19.848191 6813 leader_election.cc:302] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 830f22273fb140e7a6412f3079020741; no voters:
I20260811 12:40:19.848843 6813 leader_election.cc:288] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:19.849058 6820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:19.850456 6820 raft_consensus.cc:686] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [term 1 LEADER]: Becoming Leader. State: Replica: 830f22273fb140e7a6412f3079020741, State: Running, Role: LEADER
I20260811 12:40:19.851052 6820 consensus_queue.cc:237] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "830f22273fb140e7a6412f3079020741" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36243 } }
I20260811 12:40:19.851410 6813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:19.854161 6823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 830f22273fb140e7a6412f3079020741. Latest consensus state: current_term: 1 leader_uuid: "830f22273fb140e7a6412f3079020741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "830f22273fb140e7a6412f3079020741" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36243 } } }
I20260811 12:40:19.854563 6823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:19.854231 6822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "830f22273fb140e7a6412f3079020741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "830f22273fb140e7a6412f3079020741" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36243 } } }
I20260811 12:40:19.854720 6822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:19.856495 6829 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:19.861860 6829 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:19.871784 6829 catalog_manager.cc:1347] Generated new cluster ID: 996b11e02bca4a078a2518b8f021c898
I20260811 12:40:19.871955 6829 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:19.879501 6829 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:19.880921 6829 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:19.892499 6829 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 830f22273fb140e7a6412f3079020741: Generated new TSK 0
I20260811 12:40:19.893389 6829 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 12:40:19.941912 6850 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 12:40:19.942148 6850 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 12:40:19.943444 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:19.918279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.0.186.126:36243)
0811 12:40:19.918500 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:19.918507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:19.918987 (+ 480us) server_negotiation.cc:407] Connection header received
0811 12:40:19.919359 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:19.919366 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:19.919479 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:19.919644 (+ 165us) server_negotiation.cc:226] Negotiated authn=JWT
0811 12:40:19.920140 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:19.921383 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:19.922850 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:19.923560 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:19.923718 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:19.924379 (+ 661us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 12:40:19.942671 (+ 18292us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 12:40:19.943086 (+ 415us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41602: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 12:40:19.943590 6816 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41602: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 12:40:19.945173 6849 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:19.918119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:36243 (local address 127.0.0.1:41602)
0811 12:40:19.918865 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:19.918883 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:19.919044 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:19.919688 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:19.919691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:19.919702 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0811 12:40:19.919987 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:19.919995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:19.921551 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:19.921555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:19.922689 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:19.922701 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:19.923762 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:19.923783 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:19.923937 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:19.924002 (+ 65us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 12:40:19.943007 (+ 19005us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 12:40:19.943325 (+ 318us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.186.126:36243: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":352,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.0.186.126:36243: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 12:40:19.947419 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6733
I20260811 12:40:19.948621 6808 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:20.046898 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6733
2026-08-11T12:40:20Z chronyd exiting
I20260811 12:40:20.102846 745 test_util.cc:175] -----------------------------------------------
I20260811 12:40:20.102994 745 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786451972721996-745-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (818 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 12:40:20.108290 745 mini_oidc.cc:152] Starting JWKS server
I20260811 12:40:20.110316 745 webserver.cc:460] Webserver started at https://127.0.0.1:35575/ using document root <none> and password file <none>
I20260811 12:40:20.110530 745 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 12:40:20.111166 745 webserver.cc:460] Webserver started at http://127.0.0.1:32907/ using document root <none> and password file <none>
2026-08-11T12:40:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:20Z Disabled control of system clock
I20260811 12:40:20.152130 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35117
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:38027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35117
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35575/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/testchainca.cert with env {}
W20260811 12:40:20.498606 6857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:20.499006 6857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:20.499325 6857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:20.507331 6857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:20.507542 6857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:20.507640 6857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:20.507730 6857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:20.507817 6857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 12:40:20.507912 6857 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 12:40:20.507998 6857 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35575/jwks.json
I20260811 12:40:20.518977 6857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35117
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35575/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:20.520529 6857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:20.522063 6857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:20.535082 6866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:20.535209 6863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:20.535117 6864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:20.535931 6857 server_base.cc:1034] running on GCE node
I20260811 12:40:20.536916 6857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:20.538518 6857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:20.539795 6857 hybrid_clock.cc:648] HybridClock initialized: now 1786452020539744 us; error 61 us; skew 500 ppm
I20260811 12:40:20.540210 6857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:20.542903 6857 webserver.cc:460] Webserver started at http://127.0.186.126:42359/ using document root <none> and password file <none>
I20260811 12:40:20.543666 6857 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:20.543816 6857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:20.544173 6857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:20.547298 6857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "edb34ce0742d4084912ab5d7217dba08"
format_stamp: "Formatted at 2026-08-11 12:40:20 on dist-test-slave-qg60"
server_key: "27682b35c7202bb5f8b151e9eb1dd944"
server_key_iv: "64c9ccfda7681e0bd78f49f0c1dba6d8"
server_key_version: "encryptionkey@0"
I20260811 12:40:20.548149 6857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "edb34ce0742d4084912ab5d7217dba08"
format_stamp: "Formatted at 2026-08-11 12:40:20 on dist-test-slave-qg60"
server_key: "27682b35c7202bb5f8b151e9eb1dd944"
server_key_iv: "64c9ccfda7681e0bd78f49f0c1dba6d8"
server_key_version: "encryptionkey@0"
I20260811 12:40:20.553617 6857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260811 12:40:20.557309 6873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:20.558638 6857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 12:40:20.558841 6857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "edb34ce0742d4084912ab5d7217dba08"
format_stamp: "Formatted at 2026-08-11 12:40:20 on dist-test-slave-qg60"
server_key: "27682b35c7202bb5f8b151e9eb1dd944"
server_key_iv: "64c9ccfda7681e0bd78f49f0c1dba6d8"
server_key_version: "encryptionkey@0"
I20260811 12:40:20.559068 6857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:20.576985 6857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:20.577967 6857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:20.578322 6857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:20.598600 6857 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35117
I20260811 12:40:20.598698 6940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35117 every 8 connection(s)
I20260811 12:40:20.600422 6857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:20.604656 6941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:20.608457 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6857
I20260811 12:40:20.608672 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:20.609576 745 external_mini_cluster.cc:1428] Setting key 0d42011fed0a019fd29b7bc3c137f36e
I20260811 12:40:20.618775 6941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08: Bootstrap starting.
I20260811 12:40:20.622241 6941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:20.623507 6941 log.cc:824] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:20.624562 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:20.611821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36238 (local address 127.0.186.126:35117)
0811 12:40:20.613016 (+ 1195us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:20.613028 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:20.613082 (+ 54us) server_negotiation.cc:407] Connection header received
0811 12:40:20.614879 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:20.614905 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:20.615462 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:20.615931 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:20.616592 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:20.618003 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:20.619504 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:20.620211 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:20.620445 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:20.621694 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:20.621702 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:20.621717 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:20.622296 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:20.622427 (+ 131us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:20.622468 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:20.622609 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:20.622846 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 12:40:20.623180 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":368,"threads_started":1}
I20260811 12:40:20.627190 6941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08: No bootstrap required, opened a new log
I20260811 12:40:20.628942 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:40:20.635295 6941 raft_consensus.cc:348] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb34ce0742d4084912ab5d7217dba08" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35117 } }
I20260811 12:40:20.635700 6941 raft_consensus.cc:374] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:20.635828 6941 raft_consensus.cc:729] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb34ce0742d4084912ab5d7217dba08, State: Initialized, Role: FOLLOWER
I20260811 12:40:20.636484 6941 consensus_queue.cc:260] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb34ce0742d4084912ab5d7217dba08" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35117 } }
I20260811 12:40:20.636785 6941 raft_consensus.cc:388] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:20.636948 6941 raft_consensus.cc:482] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:20.637117 6941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:20.639832 6941 raft_consensus.cc:504] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb34ce0742d4084912ab5d7217dba08" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35117 } }
I20260811 12:40:20.640391 6941 leader_election.cc:302] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edb34ce0742d4084912ab5d7217dba08; no voters:
I20260811 12:40:20.641111 6941 leader_election.cc:288] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:20.641287 6948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:20.642485 6948 raft_consensus.cc:686] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [term 1 LEADER]: Becoming Leader. State: Replica: edb34ce0742d4084912ab5d7217dba08, State: Running, Role: LEADER
I20260811 12:40:20.643031 6948 consensus_queue.cc:237] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb34ce0742d4084912ab5d7217dba08" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35117 } }
I20260811 12:40:20.643748 6941 sys_catalog.cc:564] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:20.647258 6950 sys_catalog.cc:455] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edb34ce0742d4084912ab5d7217dba08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb34ce0742d4084912ab5d7217dba08" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35117 } } }
I20260811 12:40:20.648223 6950 sys_catalog.cc:458] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:20.646981 6951 sys_catalog.cc:455] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edb34ce0742d4084912ab5d7217dba08. Latest consensus state: current_term: 1 leader_uuid: "edb34ce0742d4084912ab5d7217dba08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb34ce0742d4084912ab5d7217dba08" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35117 } } }
I20260811 12:40:20.649751 6951 sys_catalog.cc:458] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:20.650489 6960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:20.656396 6960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:20.666679 6960 catalog_manager.cc:1347] Generated new cluster ID: 07ac313ba0d147c1a15622f92d5e3e1d
I20260811 12:40:20.666836 6960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:20.685518 6960 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:20.687071 6960 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:20.698438 6960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edb34ce0742d4084912ab5d7217dba08: Generated new TSK 0
I20260811 12:40:20.699383 6960 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 12:40:20.742653 6980 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 12:40:20.743023 6980 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260811 12:40:20.745177 6979 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:20.722004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35117 (local address 127.0.0.1:36246)
0811 12:40:20.722660 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:20.722678 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:20.722806 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:20.723371 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:20.723375 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:20.723385 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 12:40:20.723681 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:20.723689 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:20.725400 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:20.725404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:20.726567 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:20.726580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:20.727812 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:20.727817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:20.728013 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:20.728073 (+ 60us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 12:40:20.744344 (+ 16271us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 12:40:20.744663 (+ 319us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.186.126:35117: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":353,"threads_started":1}
I20260811 12:40:20.746098 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:20.722203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36246 (local address 127.0.186.126:35117)
0811 12:40:20.722469 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:20.722476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:20.722775 (+ 299us) server_negotiation.cc:407] Connection header received
0811 12:40:20.723033 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:20.723041 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:20.723150 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:20.723366 (+ 216us) server_negotiation.cc:226] Negotiated authn=JWT
0811 12:40:20.723850 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:20.725223 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:20.726754 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:20.727584 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:20.727758 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:20.728455 (+ 697us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 12:40:20.743965 (+ 15510us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 12:40:20.745779 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36246: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":96}
W20260811 12:40:20.746230 6944 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36246: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 12:40:20.747642 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6857
I20260811 12:40:20.749456 6933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:20.850858 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6857
2026-08-11T12:40:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (805 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 12:40:20.912632 745 mini_oidc.cc:152] Starting JWKS server
I20260811 12:40:20.915066 745 webserver.cc:460] Webserver started at https://127.0.0.1:36397/ using document root <none> and password file <none>
I20260811 12:40:20.915364 745 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 12:40:20.916067 745 webserver.cc:460] Webserver started at http://127.0.0.1:42791/ using document root <none> and password file <none>
2026-08-11T12:40:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:20Z Disabled control of system clock
I20260811 12:40:20.957793 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:41559
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:33877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:41559
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36397/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 12:40:21.308267 6987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:21.308655 6987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:21.308840 6987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:21.316624 6987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:21.316803 6987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:21.316905 6987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:21.317018 6987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:21.317097 6987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 12:40:21.317189 6987 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 12:40:21.317266 6987 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36397/jwks.json
I20260811 12:40:21.327098 6987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:33877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:41559
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:41559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36397/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:21.328558 6987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:21.330555 6987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:21.343492 6997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:21.343422 6995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:21.343501 6993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:21.344372 6987 server_base.cc:1034] running on GCE node
I20260811 12:40:21.345312 6987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:21.346860 6987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:21.348138 6987 hybrid_clock.cc:648] HybridClock initialized: now 1786452021348093 us; error 36 us; skew 500 ppm
I20260811 12:40:21.348546 6987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:21.351161 6987 webserver.cc:460] Webserver started at http://127.0.186.126:40041/ using document root <none> and password file <none>
I20260811 12:40:21.351922 6987 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:21.352068 6987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:21.352430 6987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:21.355526 6987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "672349a70db84c139fa4531cb1105c99"
format_stamp: "Formatted at 2026-08-11 12:40:21 on dist-test-slave-qg60"
server_key: "d0d178eddb8c3250f163348757888bc2"
server_key_iv: "9e90e26ba18b30b2490deb43ce72cb97"
server_key_version: "encryptionkey@0"
I20260811 12:40:21.356380 6987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "672349a70db84c139fa4531cb1105c99"
format_stamp: "Formatted at 2026-08-11 12:40:21 on dist-test-slave-qg60"
server_key: "d0d178eddb8c3250f163348757888bc2"
server_key_iv: "9e90e26ba18b30b2490deb43ce72cb97"
server_key_version: "encryptionkey@0"
I20260811 12:40:21.361848 6987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:40:21.365375 7003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:21.366842 6987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:21.367034 6987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "672349a70db84c139fa4531cb1105c99"
format_stamp: "Formatted at 2026-08-11 12:40:21 on dist-test-slave-qg60"
server_key: "d0d178eddb8c3250f163348757888bc2"
server_key_iv: "9e90e26ba18b30b2490deb43ce72cb97"
server_key_version: "encryptionkey@0"
I20260811 12:40:21.367269 6987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:21.404315 6987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:21.405323 6987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:21.405726 6987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:21.430723 6987 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:41559
I20260811 12:40:21.430775 7067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:41559 every 8 connection(s)
I20260811 12:40:21.432142 6987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:21.434288 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 6987
I20260811 12:40:21.434525 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:21.435202 745 external_mini_cluster.cc:1428] Setting key fafb52c7f1a6187adb491ead7da2a1e8
I20260811 12:40:21.436698 7068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:21.449290 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:21.437219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.0.186.126:41559)
0811 12:40:21.438240 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:21.438251 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:21.438295 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:40:21.439894 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:21.439916 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:21.440565 (+ 649us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:21.441077 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:21.441670 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:21.443099 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:21.444455 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:21.445228 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:21.445430 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:21.446727 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:21.446734 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:21.446752 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:21.447385 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:21.447464 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:21.447490 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:21.447649 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:21.447888 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 12:40:21.448220 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":375,"threads_started":1}
I20260811 12:40:21.449952 7068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99: Bootstrap starting.
I20260811 12:40:21.453819 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:40:21.454062 7068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:21.455143 7068 log.cc:824] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:21.458570 7068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99: No bootstrap required, opened a new log
I20260811 12:40:21.466706 7068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672349a70db84c139fa4531cb1105c99" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41559 } }
I20260811 12:40:21.467232 7068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:21.467350 7068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 672349a70db84c139fa4531cb1105c99, State: Initialized, Role: FOLLOWER
I20260811 12:40:21.467980 7068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672349a70db84c139fa4531cb1105c99" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41559 } }
I20260811 12:40:21.468220 7068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:21.468380 7068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:21.468561 7068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:21.471004 7068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672349a70db84c139fa4531cb1105c99" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41559 } }
I20260811 12:40:21.471619 7068 leader_election.cc:302] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 672349a70db84c139fa4531cb1105c99; no voters:
I20260811 12:40:21.472326 7068 leader_election.cc:288] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:21.472559 7074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:21.473963 7074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [term 1 LEADER]: Becoming Leader. State: Replica: 672349a70db84c139fa4531cb1105c99, State: Running, Role: LEADER
I20260811 12:40:21.474570 7074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672349a70db84c139fa4531cb1105c99" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41559 } }
I20260811 12:40:21.474747 7068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:21.477984 7077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 672349a70db84c139fa4531cb1105c99. Latest consensus state: current_term: 1 leader_uuid: "672349a70db84c139fa4531cb1105c99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672349a70db84c139fa4531cb1105c99" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41559 } } }
I20260811 12:40:21.478547 7077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:21.478009 7076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "672349a70db84c139fa4531cb1105c99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672349a70db84c139fa4531cb1105c99" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41559 } } }
I20260811 12:40:21.479209 7076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:21.480664 7085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:21.486683 7085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:21.496313 7085 catalog_manager.cc:1347] Generated new cluster ID: e7e759f1472f4f3f946c99ca31d549e1
I20260811 12:40:21.496470 7085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:21.512881 7085 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:21.514328 7085 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:21.524231 7085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 672349a70db84c139fa4531cb1105c99: Generated new TSK 0
I20260811 12:40:21.525285 7085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:40:21.548871 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:21.539397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58844 (local address 127.0.186.126:41559)
0811 12:40:21.539618 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:21.539626 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:21.540211 (+ 585us) server_negotiation.cc:407] Connection header received
0811 12:40:21.540456 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:21.540460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:21.540558 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:21.540771 (+ 213us) server_negotiation.cc:226] Negotiated authn=JWT
0811 12:40:21.541368 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:21.542125 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:21.544237 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:21.544802 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:21.544913 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:21.545619 (+ 706us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 12:40:21.548157 (+ 2538us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 12:40:21.548519 (+ 362us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58844: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 12:40:21.549034 7071 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58844: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 12:40:21.551017 7106 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:21.539403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41559 (local address 127.0.0.1:58844)
0811 12:40:21.540089 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:21.540110 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:21.540281 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:21.540784 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:21.540790 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:21.540805 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0811 12:40:21.541211 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:21.541225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:21.542286 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:21.542299 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:21.544072 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:21.544089 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:21.545022 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:21.545029 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:21.545255 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:21.545305 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 12:40:21.548393 (+ 3088us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 12:40:21.550530 (+ 2137us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.186.126:41559: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":1788,"thread_start_us":374,"threads_started":1}
I20260811 12:40:21.552066 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 6987
I20260811 12:40:21.553267 7061 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 12:40:21.562170 7108 webserver.cc:533] Webserver: sslize failed:
E20260811 12:40:21.562314 7108 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 12:40:21.650667 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 6987
2026-08-11T12:40:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (799 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T12:40:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:21Z Disabled control of system clock
I20260811 12:40:21.756176 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45275
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:36903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:45275
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/testchainca.cert with env {}
W20260811 12:40:22.107363 7113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:22.107684 7113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:22.107774 7113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:22.115232 7113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:22.115358 7113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:22.115397 7113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:22.115448 7113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:22.115504 7113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 12:40:22.115559 7113 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 12:40:22.115600 7113 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 12:40:22.125895 7113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:45275
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:22.127307 7113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:22.128645 7113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:22.141145 7119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:22.141254 7120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:22.141206 7122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:22.142788 7113 server_base.cc:1034] running on GCE node
I20260811 12:40:22.143607 7113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:22.145241 7113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:22.146474 7113 hybrid_clock.cc:648] HybridClock initialized: now 1786452022146412 us; error 32 us; skew 500 ppm
I20260811 12:40:22.146798 7113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:22.149258 7113 webserver.cc:460] Webserver started at http://127.0.186.126:38731/ using document root <none> and password file <none>
I20260811 12:40:22.149955 7113 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:22.150051 7113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:22.150312 7113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:22.153344 7113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "278866e10bf648cf8cbed83126b1e364"
format_stamp: "Formatted at 2026-08-11 12:40:22 on dist-test-slave-qg60"
server_key: "c90dae8eaed4694a6641efc057e43b0c"
server_key_iv: "5a4ec961c26fb0b8c66e5b5f54b5f847"
server_key_version: "encryptionkey@0"
I20260811 12:40:22.154201 7113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "278866e10bf648cf8cbed83126b1e364"
format_stamp: "Formatted at 2026-08-11 12:40:22 on dist-test-slave-qg60"
server_key: "c90dae8eaed4694a6641efc057e43b0c"
server_key_iv: "5a4ec961c26fb0b8c66e5b5f54b5f847"
server_key_version: "encryptionkey@0"
I20260811 12:40:22.159476 7113 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:40:22.163103 7130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:22.164660 7113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:40:22.164904 7113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "278866e10bf648cf8cbed83126b1e364"
format_stamp: "Formatted at 2026-08-11 12:40:22 on dist-test-slave-qg60"
server_key: "c90dae8eaed4694a6641efc057e43b0c"
server_key_iv: "5a4ec961c26fb0b8c66e5b5f54b5f847"
server_key_version: "encryptionkey@0"
I20260811 12:40:22.165148 7113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:22.177799 7113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:22.178633 7113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:22.178933 7113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:22.198642 7113 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:45275
I20260811 12:40:22.198693 7186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:45275 every 8 connection(s)
I20260811 12:40:22.200098 7113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:22.204489 7188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:22.205529 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7113
I20260811 12:40:22.205780 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:22.206842 745 external_mini_cluster.cc:1428] Setting key e32784a484fe43604c6bc5ea7dce1126
I20260811 12:40:22.219399 7188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364: Bootstrap starting.
I20260811 12:40:22.221293 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:22.209088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57332 (local address 127.0.186.126:45275)
0811 12:40:22.210417 (+ 1329us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:22.210428 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:22.210476 (+ 48us) server_negotiation.cc:407] Connection header received
0811 12:40:22.212144 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:22.212167 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:22.212721 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:22.213210 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:22.213796 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:22.215081 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:22.216406 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:22.217233 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:22.217452 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:22.218792 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:22.218799 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:22.218812 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:40:22.219409 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:22.219522 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:40:22.219551 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:22.219690 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:22.219913 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 12:40:22.220229 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":430,"threads_started":1}
I20260811 12:40:22.223189 7188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:22.224511 7188 log.cc:824] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:22.225127 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:40:22.227834 7188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364: No bootstrap required, opened a new log
I20260811 12:40:22.236877 7188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278866e10bf648cf8cbed83126b1e364" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45275 } }
I20260811 12:40:22.237354 7188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:22.237495 7188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 278866e10bf648cf8cbed83126b1e364, State: Initialized, Role: FOLLOWER
I20260811 12:40:22.238235 7188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278866e10bf648cf8cbed83126b1e364" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45275 } }
I20260811 12:40:22.238509 7188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:22.238710 7188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:22.238904 7188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:22.241724 7188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278866e10bf648cf8cbed83126b1e364" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45275 } }
I20260811 12:40:22.242563 7188 leader_election.cc:302] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 278866e10bf648cf8cbed83126b1e364; no voters:
I20260811 12:40:22.243333 7188 leader_election.cc:288] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:22.243494 7194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:22.244272 7194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [term 1 LEADER]: Becoming Leader. State: Replica: 278866e10bf648cf8cbed83126b1e364, State: Running, Role: LEADER
I20260811 12:40:22.244949 7194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278866e10bf648cf8cbed83126b1e364" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45275 } }
I20260811 12:40:22.245937 7188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:22.247846 7197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 278866e10bf648cf8cbed83126b1e364. Latest consensus state: current_term: 1 leader_uuid: "278866e10bf648cf8cbed83126b1e364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278866e10bf648cf8cbed83126b1e364" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45275 } } }
I20260811 12:40:22.247884 7195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "278866e10bf648cf8cbed83126b1e364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "278866e10bf648cf8cbed83126b1e364" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45275 } } }
I20260811 12:40:22.248364 7195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:22.248391 7197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:22.254125 7200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:22.259383 7200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:22.268535 7200 catalog_manager.cc:1347] Generated new cluster ID: e231c63a33144907a771c3858eea6d26
I20260811 12:40:22.268786 7200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:22.280164 7200 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:22.281570 7200 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:22.289301 7200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 278866e10bf648cf8cbed83126b1e364: Generated new TSK 0
I20260811 12:40:22.290192 7200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:40:22.775353 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:22.310080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57334 (local address 127.0.186.126:45275)
0811 12:40:22.310361 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:22.310371 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:22.310947 (+ 576us) server_negotiation.cc:407] Connection header received
0811 12:40:22.311202 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:22.311208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:22.311323 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:22.311528 (+ 205us) server_negotiation.cc:226] Negotiated authn=JWT
0811 12:40:22.311978 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:22.313289 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:22.314751 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:22.315519 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:22.315680 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:22.316243 (+ 563us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 12:40:22.774746 (+458503us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 12:40:22.775095 (+ 349us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57334: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 12:40:22.775480 7192 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57334: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 12:40:22.775769 7223 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:22.309876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45275 (local address 127.0.0.1:57334)
0811 12:40:22.310817 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:22.310839 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:22.310969 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:22.311538 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:22.311542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:22.311552 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 12:40:22.311817 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:22.311825 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:22.313447 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:22.313451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:22.314589 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:22.314600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:22.315711 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:22.315716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:22.315856 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:22.315891 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 12:40:22.775051 (+459160us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 12:40:22.775336 (+ 285us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.186.126:45275: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":789,"thread_start_us":644,"threads_started":1}
I20260811 12:40:22.777071 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7113
I20260811 12:40:22.778297 7182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:22.886497 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7113
2026-08-11T12:40:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1218 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (449 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1588 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:25 dist-test-slave-qg60 krb5kdc[7242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:25 dist-test-slave-qg60 krb5kdc[7242](info): set up 2 sockets
Aug 11 12:40:25 dist-test-slave-qg60 krb5kdc[7242](info): commencing operation
krb5kdc: starting...
W20260811 12:40:26.179239 745 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:26 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:26.477923 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:36449
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:26.843340 7257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:26.843659 7257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:26.843755 7257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:26.852090 7257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:26.852236 7257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:26.852299 7257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:26.852368 7257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:26.852421 7257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:26.863894 7257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:36449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:26.865567 7257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:26.867065 7257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:26.880041 7264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:26.880118 7262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:26.880090 7266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:26.880842 7257 server_base.cc:1034] running on GCE node
I20260811 12:40:26.881883 7257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:26.883738 7257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:26.885025 7257 hybrid_clock.cc:648] HybridClock initialized: now 1786452026884952 us; error 61 us; skew 500 ppm
I20260811 12:40:26.885412 7257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:26 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452026, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:26.889190 7257 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:26.890815 7257 webserver.cc:460] Webserver started at http://127.0.186.126:38341/ using document root <none> and password file <none>
I20260811 12:40:26.891570 7257 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:26.891714 7257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:26.892068 7257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:26.895331 7257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "c1f91307b5f649df8a7a75ecd0395d86"
format_stamp: "Formatted at 2026-08-11 12:40:26 on dist-test-slave-qg60"
server_key: "d71a519da3c7836175b8e0d1faf2d5e4"
server_key_iv: "d8679457ae921a890868bb13bee4843a"
server_key_version: "encryptionkey@0"
I20260811 12:40:26.896240 7257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "c1f91307b5f649df8a7a75ecd0395d86"
format_stamp: "Formatted at 2026-08-11 12:40:26 on dist-test-slave-qg60"
server_key: "d71a519da3c7836175b8e0d1faf2d5e4"
server_key_iv: "d8679457ae921a890868bb13bee4843a"
server_key_version: "encryptionkey@0"
I20260811 12:40:26.901877 7257 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 12:40:26.905923 7273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:26.907512 7257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:40:26.907713 7257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "c1f91307b5f649df8a7a75ecd0395d86"
format_stamp: "Formatted at 2026-08-11 12:40:26 on dist-test-slave-qg60"
server_key: "d71a519da3c7836175b8e0d1faf2d5e4"
server_key_iv: "d8679457ae921a890868bb13bee4843a"
server_key_version: "encryptionkey@0"
I20260811 12:40:26.907908 7257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:26.929433 7257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:26.933926 7257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:26.934232 7257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:26.954470 7257 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:36449
I20260811 12:40:26.954514 7334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:36449 every 8 connection(s)
I20260811 12:40:26.955984 7257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:26.957569 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7257
I20260811 12:40:26.957785 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:26.958652 745 external_mini_cluster.cc:1428] Setting key fd307bb789eda94b5f92cafbd0d8ffce
I20260811 12:40:26.961199 7336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:40:26 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:26.975069 7336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86: Bootstrap starting.
I20260811 12:40:26.979821 7336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:26.981237 7336 log.cc:824] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:26.984894 7336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86: No bootstrap required, opened a new log
I20260811 12:40:26.985527 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:26.960992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32890 (local address 127.0.186.126:36449)
0811 12:40:26.961820 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:26.961836 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:26.961889 (+ 53us) server_negotiation.cc:407] Connection header received
0811 12:40:26.964189 (+ 2300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:26.964215 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:26.964760 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:26.965218 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:26.966580 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:26.968660 (+ 2080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:26.970041 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:26.971119 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:26.971324 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:26.975662 (+ 4338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:26.975673 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:26.975692 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:26.975743 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:26.980441 (+ 4698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:26.981242 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:26.981252 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:26.981263 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:26.981480 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:26.981951 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:26.981958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:26.981961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:26.982588 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:26.982990 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:26.983610 (+ 620us) server_negotiation.cc:299] Negotiation successful
0811 12:40:26.984088 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":344,"threads_started":1}
I20260811 12:40:26.993585 7336 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f91307b5f649df8a7a75ecd0395d86" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36449 } }
I20260811 12:40:26.993960 7336 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:26.994038 7336 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91307b5f649df8a7a75ecd0395d86, State: Initialized, Role: FOLLOWER
I20260811 12:40:26.994612 7336 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f91307b5f649df8a7a75ecd0395d86" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36449 } }
I20260811 12:40:26.994824 7336 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:26.994931 7336 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:26.995064 7336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:26.997632 7336 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f91307b5f649df8a7a75ecd0395d86" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36449 } }
I20260811 12:40:26.998148 7336 leader_election.cc:302] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1f91307b5f649df8a7a75ecd0395d86; no voters:
I20260811 12:40:26.998761 7336 leader_election.cc:288] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:26.998934 7341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:27.000129 7341 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [term 1 LEADER]: Becoming Leader. State: Replica: c1f91307b5f649df8a7a75ecd0395d86, State: Running, Role: LEADER
I20260811 12:40:27.000890 7341 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f91307b5f649df8a7a75ecd0395d86" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36449 } }
I20260811 12:40:27.001214 7336 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:27.004117 7344 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1f91307b5f649df8a7a75ecd0395d86. Latest consensus state: current_term: 1 leader_uuid: "c1f91307b5f649df8a7a75ecd0395d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f91307b5f649df8a7a75ecd0395d86" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36449 } } }
I20260811 12:40:27.004542 7344 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:27.004576 7342 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1f91307b5f649df8a7a75ecd0395d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f91307b5f649df8a7a75ecd0395d86" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 36449 } } }
I20260811 12:40:27.004984 7342 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:27.005774 7351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:27.011962 7351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:27.021306 7351 catalog_manager.cc:1347] Generated new cluster ID: 3b70a0463c564949b535c1c5bb7da4d3
I20260811 12:40:27.021450 7351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:27.040429 7351 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:27.041925 7351 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:27.053524 7351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1f91307b5f649df8a7a75ecd0395d86: Generated new TSK 0
I20260811 12:40:27.054466 7351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:40:27.126958 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:36449
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:27.487512 7366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:27.487851 7366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:27.488016 7366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:27.495813 7366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:27.496001 7366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:27.496181 7366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:27.506878 7366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:27.508330 7366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:27.509826 7366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:27.524621 7373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:27.524530 7374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:27.524571 7376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:27.525632 7366 server_base.cc:1034] running on GCE node
I20260811 12:40:27.526301 7366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:27.527256 7366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:27.528477 7366 hybrid_clock.cc:648] HybridClock initialized: now 1786452027528447 us; error 47 us; skew 500 ppm
I20260811 12:40:27.528980 7366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:27 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452027, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:27.533083 7366 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:40:27.539032 7366 webserver.cc:460] Webserver started at http://127.0.186.65:40255/ using document root <none> and password file <none>
I20260811 12:40:27.539798 7366 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:27.539948 7366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:27.540297 7366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:27.543505 7366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "e52fb646ee8240d2a332bbbd9f0bf3e0"
format_stamp: "Formatted at 2026-08-11 12:40:27 on dist-test-slave-qg60"
server_key: "46f2d4da220d7560163fad35be0b524f"
server_key_iv: "36abf1bcf8cbeb4f3244f8b45bf5c35c"
server_key_version: "encryptionkey@0"
I20260811 12:40:27.544463 7366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "e52fb646ee8240d2a332bbbd9f0bf3e0"
format_stamp: "Formatted at 2026-08-11 12:40:27 on dist-test-slave-qg60"
server_key: "46f2d4da220d7560163fad35be0b524f"
server_key_iv: "36abf1bcf8cbeb4f3244f8b45bf5c35c"
server_key_version: "encryptionkey@0"
I20260811 12:40:27.550321 7366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 12:40:27.554581 7383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:27.556461 7366 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:40:27.556707 7366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "e52fb646ee8240d2a332bbbd9f0bf3e0"
format_stamp: "Formatted at 2026-08-11 12:40:27 on dist-test-slave-qg60"
server_key: "46f2d4da220d7560163fad35be0b524f"
server_key_iv: "36abf1bcf8cbeb4f3244f8b45bf5c35c"
server_key_version: "encryptionkey@0"
I20260811 12:40:27.557010 7366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:27.582945 7366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:27.588043 7366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:27.588332 7366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:27.589447 7366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:27.590924 7366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:27.591019 7366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:27.591115 7366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:27.591176 7366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:27.630252 7366 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:46569
I20260811 12:40:27.630343 7521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:46569 every 8 connection(s)
I20260811 12:40:27.631711 7366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:27.636508 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7366
I20260811 12:40:27.636754 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:27.637662 745 external_mini_cluster.cc:1428] Setting key 6cd8fef008275f4a3c15871f94217865
Aug 11 12:40:27 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452027, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:27.657459 7525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:27.634650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:57385 (local address 127.0.186.126:36449)
0811 12:40:27.635161 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:27.635165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:27.636248 (+ 1083us) server_negotiation.cc:407] Connection header received
0811 12:40:27.638944 (+ 2696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:27.638950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:27.639039 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:27.639173 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:27.641302 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:27.642147 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:27.644798 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:27.645253 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:27.645372 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:27.650018 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:27.650023 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:27.650026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:27.650065 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:27.653870 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:27.654920 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:27.654924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:27.654927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:27.655072 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:27.655544 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:27.655548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:27.655550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:27.655836 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:27.656033 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:27.656813 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 12:40:27.657069 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":283,"threads_started":1}
I20260811 12:40:27.658496 7526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:27.635147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:36449 (local address 127.0.186.65:57385)
0811 12:40:27.635931 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:27.636081 (+ 150us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:27.638627 (+ 2546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:27.639359 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:27.639367 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:27.640181 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:27.641082 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:27.641112 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:27.642337 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:27.642346 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:27.644535 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:27.644554 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:27.645510 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:27.645519 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:27.645866 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:27.646695 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:27.646733 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:27.649756 (+ 3023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:27.654114 (+ 4358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:27.654123 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:27.654138 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:27.654761 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:27.655197 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:27.655202 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:27.655206 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:27.655409 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:27.655983 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:27.655992 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:27.656377 (+ 385us) client_negotiation.cc:769] Sending connection context
0811 12:40:27.656663 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 12:40:27.657286 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":333,"threads_started":1}
I20260811 12:40:27.660342 7523 heartbeater.cc:347] Connected to a master server at 127.0.186.126:36449
I20260811 12:40:27.660703 7523 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:27.661614 7523 heartbeater.cc:511] Master 127.0.186.126:36449 requested a full tablet report, sending...
I20260811 12:40:27.663932 7294 ts_manager.cc:194] Registered new tserver with Master: e52fb646ee8240d2a332bbbd9f0bf3e0 (127.0.186.65:46569)
I20260811 12:40:27.665498 7294 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:57385
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:40:27.701333 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:36449
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:28.057400 7530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:28.057749 7530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:28.057909 7530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:28.065516 7530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:28.065644 7530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:28.065762 7530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:28.076000 7530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:28.077702 7530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:28.079167 7530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:28.093468 7539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:28.093362 7541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:28.093408 7538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:28.095120 7530 server_base.cc:1034] running on GCE node
I20260811 12:40:28.095798 7530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:28.096915 7530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:28.098162 7530 hybrid_clock.cc:648] HybridClock initialized: now 1786452028098107 us; error 44 us; skew 500 ppm
I20260811 12:40:28.098505 7530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.102031 7530 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:40:28.103826 7530 webserver.cc:460] Webserver started at http://127.0.186.66:40449/ using document root <none> and password file <none>
I20260811 12:40:28.104676 7530 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:28.104854 7530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:28.105250 7530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:28.108677 7530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "35f5fa11bfa940e49361ccc9cf0216ba"
format_stamp: "Formatted at 2026-08-11 12:40:28 on dist-test-slave-qg60"
server_key: "c2725ae02e4a97677b35c1030fdba2c9"
server_key_iv: "fda4a49aeb19803fcabba3a83136b876"
server_key_version: "encryptionkey@0"
I20260811 12:40:28.109731 7530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "35f5fa11bfa940e49361ccc9cf0216ba"
format_stamp: "Formatted at 2026-08-11 12:40:28 on dist-test-slave-qg60"
server_key: "c2725ae02e4a97677b35c1030fdba2c9"
server_key_iv: "fda4a49aeb19803fcabba3a83136b876"
server_key_version: "encryptionkey@0"
I20260811 12:40:28.116194 7530 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 12:40:28.120348 7551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:28.122072 7530 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:40:28.122239 7530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "35f5fa11bfa940e49361ccc9cf0216ba"
format_stamp: "Formatted at 2026-08-11 12:40:28 on dist-test-slave-qg60"
server_key: "c2725ae02e4a97677b35c1030fdba2c9"
server_key_iv: "fda4a49aeb19803fcabba3a83136b876"
server_key_version: "encryptionkey@0"
I20260811 12:40:28.122452 7530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:28.139807 7530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:28.144456 7530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:28.144794 7530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:28.145836 7530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:28.147272 7530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:28.147354 7530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:28.147449 7530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:28.147495 7530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:28.183810 7530 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:34305
I20260811 12:40:28.183902 7683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:34305 every 8 connection(s)
I20260811 12:40:28.185211 7530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:28.190732 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7530
I20260811 12:40:28.190914 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:28.191362 745 external_mini_cluster.cc:1428] Setting key e85870ca0460bd4d511feb2925f188e3
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:28.207046 7686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.188023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:54601 (local address 127.0.186.126:36449)
0811 12:40:28.188493 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.188498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.189673 (+ 1175us) server_negotiation.cc:407] Connection header received
0811 12:40:28.191688 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.191693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.191791 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.191909 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.193730 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.194507 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.196125 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.196570 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.196710 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.200542 (+ 3832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:28.200548 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:28.200551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:28.200587 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:28.203636 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.204497 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.204502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.204504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.204643 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.205105 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.205109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.205111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.205454 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:28.205611 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:28.206380 (+ 769us) server_negotiation.cc:299] Negotiation successful
0811 12:40:28.206631 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":237,"threads_started":1}
I20260811 12:40:28.208067 7687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.188587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:36449 (local address 127.0.186.66:54601)
0811 12:40:28.189494 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:28.189535 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:28.191384 (+ 1849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:28.192191 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:28.192204 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:28.192879 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:28.193554 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:28.193578 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.194679 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.194683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:28.195965 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:28.195977 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.196853 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.196861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:28.197093 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.197925 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:28.197950 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:28.200284 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:28.203790 (+ 3506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:28.203799 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:28.203818 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:28.204365 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:28.204774 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:28.204779 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:28.204782 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:28.204976 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:28.205585 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:28.205593 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:28.205984 (+ 391us) client_negotiation.cc:769] Sending connection context
0811 12:40:28.206282 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 12:40:28.206871 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":388,"threads_started":1}
I20260811 12:40:28.209760 7684 heartbeater.cc:347] Connected to a master server at 127.0.186.126:36449
I20260811 12:40:28.210086 7684 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:28.210851 7684 heartbeater.cc:511] Master 127.0.186.126:36449 requested a full tablet report, sending...
I20260811 12:40:28.212631 7294 ts_manager.cc:194] Registered new tserver with Master: 35f5fa11bfa940e49361ccc9cf0216ba (127.0.186.66:34305)
I20260811 12:40:28.214046 7294 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:54601
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:40:28.257105 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:36449
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:28.619381 7690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:28.619769 7690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:28.619949 7690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:28.627805 7690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:28.627992 7690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:28.628170 7690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:28.641006 7690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:36449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:28.642366 7690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:28.643746 7690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:28.657505 7700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:28.657713 7696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:28.657687 7697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:28.658599 7690 server_base.cc:1034] running on GCE node
I20260811 12:40:28.659219 7690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:28.660202 7690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:28.661420 7690 hybrid_clock.cc:648] HybridClock initialized: now 1786452028661343 us; error 60 us; skew 500 ppm
I20260811 12:40:28.661808 7690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.665386 7690 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:40:28.667083 7690 webserver.cc:460] Webserver started at http://127.0.186.67:45855/ using document root <none> and password file <none>
I20260811 12:40:28.667855 7690 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:28.668030 7690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:28.668363 7690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:28.668710 7523 heartbeater.cc:503] Master 127.0.186.126:36449 was elected leader, sending a full tablet report...
I20260811 12:40:28.672330 7690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "669d151ed2da454fa1e6fc56b2079341"
format_stamp: "Formatted at 2026-08-11 12:40:28 on dist-test-slave-qg60"
server_key: "aa54ea28461ad64b0ac4046e05dd25fd"
server_key_iv: "b3b39f5e7fc4dc8984dc68aa8d9afe4c"
server_key_version: "encryptionkey@0"
I20260811 12:40:28.673280 7690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "669d151ed2da454fa1e6fc56b2079341"
format_stamp: "Formatted at 2026-08-11 12:40:28 on dist-test-slave-qg60"
server_key: "aa54ea28461ad64b0ac4046e05dd25fd"
server_key_iv: "b3b39f5e7fc4dc8984dc68aa8d9afe4c"
server_key_version: "encryptionkey@0"
I20260811 12:40:28.679148 7690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:40:28.682976 7708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:28.684453 7690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:40:28.684666 7690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "669d151ed2da454fa1e6fc56b2079341"
format_stamp: "Formatted at 2026-08-11 12:40:28 on dist-test-slave-qg60"
server_key: "aa54ea28461ad64b0ac4046e05dd25fd"
server_key_iv: "b3b39f5e7fc4dc8984dc68aa8d9afe4c"
server_key_version: "encryptionkey@0"
I20260811 12:40:28.684988 7690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:28.714005 7690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:28.718743 7690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:28.719067 7690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:28.720228 7690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:28.721846 7690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:28.721954 7690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:28.722105 7690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:28.722163 7690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:28.762903 7690 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:38567
I20260811 12:40:28.763046 7837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:38567 every 8 connection(s)
I20260811 12:40:28.764261 7690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:28.768604 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7690
I20260811 12:40:28.768816 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:28.769325 745 external_mini_cluster.cc:1428] Setting key 807ec0026c30fc6120ee2e442ff70fd7
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:28.786906 7840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.767137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:52683 (local address 127.0.186.126:36449)
0811 12:40:28.767663 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.767669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.768591 (+ 922us) server_negotiation.cc:407] Connection header received
0811 12:40:28.770844 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.770850 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.770961 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.771078 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.773058 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.774247 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.776169 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.776608 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.776715 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.780371 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:28.780376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:28.780380 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:28.780416 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:28.783279 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.784373 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.784379 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.784383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.784578 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.785164 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.785169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.785172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.785539 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:28.785674 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:28.786393 (+ 719us) server_negotiation.cc:299] Negotiation successful
0811 12:40:28.786588 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":275,"threads_started":1}
I20260811 12:40:28.787884 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.767553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:36449 (local address 127.0.186.67:52683)
0811 12:40:28.768417 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:28.768459 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:28.770551 (+ 2092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:28.771328 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:28.771339 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:28.771911 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:28.772822 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:28.772863 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.774443 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.774451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:28.776026 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:28.776040 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.776856 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.776862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:28.777058 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.777800 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:28.777822 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:28.780132 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:28.783425 (+ 3293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:28.783435 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:28.783451 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:28.784094 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:28.784716 (+ 622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:28.784721 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:28.784763 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:28.784979 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:28.785672 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:28.785678 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:28.786021 (+ 343us) client_negotiation.cc:769] Sending connection context
0811 12:40:28.786261 (+ 240us) client_negotiation.cc:240] Negotiation successful
0811 12:40:28.786690 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":340,"threads_started":1}
I20260811 12:40:28.789474 7838 heartbeater.cc:347] Connected to a master server at 127.0.186.126:36449
I20260811 12:40:28.789805 7838 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:28.790737 7838 heartbeater.cc:511] Master 127.0.186.126:36449 requested a full tablet report, sending...
I20260811 12:40:28.792279 7294 ts_manager.cc:194] Registered new tserver with Master: 669d151ed2da454fa1e6fc56b2079341 (127.0.186.67:38567)
I20260811 12:40:28.793233 7294 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:52683
I20260811 12:40:28.798234 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/test-admin.keytab.
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.835224 745 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 12:40:28.840958 7846 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:28.838312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59606 (local address 127.0.186.65:46569)
0811 12:40:28.839016 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.839023 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.839054 (+ 31us) server_negotiation.cc:407] Connection header received
0811 12:40:28.839132 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.839139 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.839363 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.839541 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.840487 (+ 946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59606: BlockingRecv error: recv got EOF from 127.0.0.1:59606 (error 108)
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":360,"threads_started":1}
W20260811 12:40:28.841270 745 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc)
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.842963 745 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.844398 745 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:28.861058 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.846247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.0.186.65:46569)
0811 12:40:28.846443 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.846452 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.846582 (+ 130us) server_negotiation.cc:407] Connection header received
0811 12:40:28.846765 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.846769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.846839 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.847019 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.848079 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.849196 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.850453 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.851060 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.851227 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.855082 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:28.855097 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:28.855112 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:28.855166 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:28.858039 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.858788 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.858796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.858798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.858926 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.859296 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.859302 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.859305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.859689 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:28.859997 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:28.860337 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 12:40:28.860664 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 12:40:28.867331 7846 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:28.865652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59622 (local address 127.0.186.65:46569)
0811 12:40:28.865896 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.865901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.866105 (+ 204us) server_negotiation.cc:407] Connection header received
0811 12:40:28.866251 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.866254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.866312 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.866382 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.867057 (+ 675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59622: BlockingRecv error: recv got EOF from 127.0.0.1:59622 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260811 12:40:28.867457 745 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc' of type FILE
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.869163 745 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.870577 745 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:28.885042 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.871821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.0.186.65:46569)
0811 12:40:28.872029 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.872035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.872260 (+ 225us) server_negotiation.cc:407] Connection header received
0811 12:40:28.872385 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.872388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.872443 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.872520 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.873520 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.874234 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.875373 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.875808 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.875897 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.879744 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:28.879749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:28.879752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:28.879785 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:28.882386 (+ 2601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.883081 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.883086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.883099 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.883227 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.883599 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.883607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.883610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.883881 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:28.884176 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:28.884508 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 12:40:28.884762 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 12:40:28.889709 7846 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:28.887749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59640 (local address 127.0.186.65:46569)
0811 12:40:28.887908 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.887912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.888306 (+ 394us) server_negotiation.cc:407] Connection header received
0811 12:40:28.888422 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.888425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.888491 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.888570 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.889399 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59640: BlockingRecv error: recv got EOF from 127.0.0.1:59640 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 12:40:28.889842 745 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786451972721996-745-0/krb5kdc/krb5cc' of type FILE
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.891528 745 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:28.892937 745 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 12:40:28 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:28.908674 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.894302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.0.186.65:46569)
0811 12:40:28.894525 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.894530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.894732 (+ 202us) server_negotiation.cc:407] Connection header received
0811 12:40:28.894861 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.894864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.894925 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.895007 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.896016 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.896837 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.898062 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.898497 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.898598 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.902911 (+ 4313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:28.902916 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:28.902920 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:28.902957 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:28.905887 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.906679 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.906683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.906685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.906826 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.907234 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.907237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.907239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.907536 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:28.907777 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:28.908112 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 12:40:28.908326 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 12:40:28.910542 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7366
I20260811 12:40:28.924690 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:28.911574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59656 (local address 127.0.186.65:46569)
0811 12:40:28.911828 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:28.911835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:28.912115 (+ 280us) server_negotiation.cc:407] Connection header received
0811 12:40:28.912338 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:28.912344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:28.912423 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:28.912535 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:28.913742 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.914508 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.915893 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:28.916387 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:28.916542 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:28.918958 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:28.918970 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:28.918975 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:28.919017 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:28.921790 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.922532 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.922538 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.922542 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.922706 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:28.923101 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:28.923107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:28.923111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:28.923414 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:28.923763 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:28.924063 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 12:40:28.924310 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 12:40:28.925518 7516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:29.013928 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7366
I20260811 12:40:29.037542 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7530
Aug 11 12:40:29 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:40:29.053735 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:29.038465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33772 (local address 127.0.186.66:34305)
0811 12:40:29.039089 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:29.039096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:29.039123 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:40:29.039186 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:29.039193 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:29.039398 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:29.039538 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:29.040482 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:29.041697 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:29.043038 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:29.043613 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:29.043715 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:29.047846 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:29.047860 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:29.047876 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:29.047942 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:29.050956 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:29.051685 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:29.051698 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:29.051704 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:29.051871 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:29.052188 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:29.052191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:29.052193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:29.052558 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:29.052858 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:29.053188 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 12:40:29.053397 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":321,"threads_started":1}
I20260811 12:40:29.055065 7679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:29.141112 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7530
I20260811 12:40:29.161921 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7690
Aug 11 12:40:29 dist-test-slave-qg60 krb5kdc[7242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:40:29.178467 7864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:29.163096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.0.186.67:38567)
0811 12:40:29.163752 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:29.163759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:29.163788 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:40:29.163851 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:29.163857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:29.164072 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:29.164260 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:29.165535 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:29.166583 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:29.167876 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:29.168460 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:29.168601 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:29.172915 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:29.172928 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:29.172942 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:29.172979 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:29.175848 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:29.176544 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:29.176551 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:29.176554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:29.176676 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:29.177108 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:29.177111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:29.177113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:29.177480 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:29.177742 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:29.177951 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 12:40:29.178174 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":330,"threads_started":1}
I20260811 12:40:29.179818 7833 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:29.266407 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7690
I20260811 12:40:29.289510 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7257
I20260811 12:40:29.290889 7329 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:29.399369 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7257
2026-08-11T12:40:29Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4477 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:29 dist-test-slave-qg60 krb5kdc[7869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:29 dist-test-slave-qg60 krb5kdc[7869](info): set up 2 sockets
Aug 11 12:40:29 dist-test-slave-qg60 krb5kdc[7869](info): commencing operation
krb5kdc: starting...
W20260811 12:40:30.615739 745 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.006s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:30 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab.
Entry for principal oryx/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab.
I20260811 12:40:30.920905 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39593
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab
--principal=oryx/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:31.271638 7887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:31.271981 7887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:31.272167 7887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:31.279942 7887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:31.280092 7887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:31.280200 7887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:31.280297 7887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:31.280350 7887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:31.290880 7887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab
--principal=oryx/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:31.292405 7887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:31.293951 7887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:31.307685 7893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:31.307775 7896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:31.307747 7894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:31.309315 7887 server_base.cc:1034] running on GCE node
I20260811 12:40:31.310206 7887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:31.311784 7887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:31.313076 7887 hybrid_clock.cc:648] HybridClock initialized: now 1786452031312986 us; error 66 us; skew 500 ppm
I20260811 12:40:31.313459 7887 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:31 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452031, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:31.324160 7887 init.cc:377] Logged in from keytab as oryx/127.0.186.126@KRBTEST.COM (short username oryx)
I20260811 12:40:31.326014 7887 webserver.cc:460] Webserver started at http://127.0.186.126:34081/ using document root <none> and password file <none>
I20260811 12:40:31.326797 7887 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:31.326956 7887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:31.327299 7887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:31.330827 7887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "4d3c21f28c6d4a458d25e4e8574ffa04"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "360df6d2fa55ce15be41257703b18142"
server_key_iv: "c946779d778e086e0186d5024608d82c"
server_key_version: "encryptionkey@0"
I20260811 12:40:31.331820 7887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "4d3c21f28c6d4a458d25e4e8574ffa04"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "360df6d2fa55ce15be41257703b18142"
server_key_iv: "c946779d778e086e0186d5024608d82c"
server_key_version: "encryptionkey@0"
I20260811 12:40:31.338047 7887 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 12:40:31.342399 7904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:31.344013 7887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260811 12:40:31.344281 7887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "4d3c21f28c6d4a458d25e4e8574ffa04"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "360df6d2fa55ce15be41257703b18142"
server_key_iv: "c946779d778e086e0186d5024608d82c"
server_key_version: "encryptionkey@0"
I20260811 12:40:31.344511 7887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:31.377862 7887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:31.382759 7887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:31.383081 7887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:31.404217 7887 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39593
I20260811 12:40:31.404237 7965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39593 every 8 connection(s)
I20260811 12:40:31.405781 7887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:31.410012 7967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:31.410367 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7887
I20260811 12:40:31.410605 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:31.411496 745 external_mini_cluster.cc:1428] Setting key 1c27dcf8d07fe43f946b0f5d299bab68
I20260811 12:40:31.426599 7967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Bootstrap starting.
Aug 11 12:40:31 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:31.431206 7967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:31.432986 7967 log.cc:824] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:31.437613 7967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: No bootstrap required, opened a new log
I20260811 12:40:31.441613 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:31.413847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56106 (local address 127.0.186.126:39593)
0811 12:40:31.414720 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:31.414732 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:31.414773 (+ 41us) server_negotiation.cc:407] Connection header received
0811 12:40:31.417083 (+ 2310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:31.417107 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:31.417554 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:31.417917 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:31.420447 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:31.421977 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:31.424087 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:31.424849 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:31.425000 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:31.431370 (+ 6370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:31.431384 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:31.431404 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:31.431460 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:31.436352 (+ 4892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:31.437409 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:31.437416 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:31.437423 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:31.437609 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:31.438060 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:31.438063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:31.438065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:31.438651 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:31.439006 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:31.439524 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 12:40:31.440066 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":412,"threads_started":1}
I20260811 12:40:31.446602 7967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } }
I20260811 12:40:31.446959 7967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:31.447077 7967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3c21f28c6d4a458d25e4e8574ffa04, State: Initialized, Role: FOLLOWER
I20260811 12:40:31.447762 7967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } }
I20260811 12:40:31.448052 7967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:31.448241 7967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:31.448421 7967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:31.450862 7967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } }
I20260811 12:40:31.451458 7967 leader_election.cc:302] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d3c21f28c6d4a458d25e4e8574ffa04; no voters:
I20260811 12:40:31.452205 7967 leader_election.cc:288] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:31.452349 7972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:31.453235 7972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 LEADER]: Becoming Leader. State: Replica: 4d3c21f28c6d4a458d25e4e8574ffa04, State: Running, Role: LEADER
I20260811 12:40:31.453810 7972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } }
I20260811 12:40:31.454542 7967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:31.456650 7973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } }
I20260811 12:40:31.457086 7973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:31.458087 7974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d3c21f28c6d4a458d25e4e8574ffa04. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } }
I20260811 12:40:31.458549 7974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:31.459525 7979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:31.466814 7979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:31.476816 7979 catalog_manager.cc:1347] Generated new cluster ID: 6e96288315a7474db5368c83256280c6
I20260811 12:40:31.476964 7979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:31.495812 7979 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:31.497349 7979 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:31.508271 7979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Generated new TSK 0
I20260811 12:40:31.509246 7979 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab.
Entry for principal oryx/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab.
I20260811 12:40:31.581070 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39593
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:31.940966 7995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:31.941272 7995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:31.941371 7995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:31.948880 7995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:31.949021 7995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:31.949139 7995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:31.959551 7995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:31.961102 7995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:31.962442 7995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:31.976562 8000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:31.976648 8003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:31.976605 8001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:31.977595 7995 server_base.cc:1034] running on GCE node
I20260811 12:40:31.978304 7995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:31.979395 7995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:31.980633 7995 hybrid_clock.cc:648] HybridClock initialized: now 1786452031980576 us; error 58 us; skew 500 ppm
I20260811 12:40:31.980993 7995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:31 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452031, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:31.984483 7995 init.cc:377] Logged in from keytab as oryx/127.0.186.65@KRBTEST.COM (short username oryx)
I20260811 12:40:31.986126 7995 webserver.cc:460] Webserver started at http://127.0.186.65:44951/ using document root <none> and password file <none>
I20260811 12:40:31.986848 7995 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:31.986996 7995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:31.987330 7995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:31.990499 7995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "a6bb570a462642a689a72ca6ae0711f6"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "9c48e9e87784a218921841cd5068407a"
server_key_iv: "29f8060c2b344b2e2d340d7674ad3100"
server_key_version: "encryptionkey@0"
I20260811 12:40:31.991354 7995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "a6bb570a462642a689a72ca6ae0711f6"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "9c48e9e87784a218921841cd5068407a"
server_key_iv: "29f8060c2b344b2e2d340d7674ad3100"
server_key_version: "encryptionkey@0"
I20260811 12:40:31.997124 7995 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 12:40:32.001336 8011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:32.003018 7995 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 12:40:32.003268 7995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "a6bb570a462642a689a72ca6ae0711f6"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "9c48e9e87784a218921841cd5068407a"
server_key_iv: "29f8060c2b344b2e2d340d7674ad3100"
server_key_version: "encryptionkey@0"
I20260811 12:40:32.003562 7995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:32.022388 7995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:32.026942 7995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:32.027372 7995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:32.028465 7995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:32.030207 7995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:32.030319 7995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:32.030479 7995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:32.030555 7995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:32.067039 7995 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:37865
I20260811 12:40:32.067160 8143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:37865 every 8 connection(s)
I20260811 12:40:32.068435 7995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:32.070770 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 7995
I20260811 12:40:32.070979 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:32.071782 745 external_mini_cluster.cc:1428] Setting key b662c3c25dae8832b8326be77a426a50
Aug 11 12:40:32 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452031, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:32.089968 8146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:32.071510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:55905 (local address 127.0.186.126:39593)
0811 12:40:32.072065 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:32.072071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:32.073279 (+ 1208us) server_negotiation.cc:407] Connection header received
0811 12:40:32.075324 (+ 2045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:32.075330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:32.075422 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:32.075548 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:32.077191 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.077975 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.079557 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.079965 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.080104 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:32.083707 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:32.083712 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:32.083716 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:32.083751 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:32.086690 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:32.087461 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:32.087467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:32.087470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:32.087612 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:32.088076 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:32.088080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:32.088082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:32.088354 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:32.088523 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:32.089318 (+ 795us) server_negotiation.cc:299] Negotiation successful
0811 12:40:32.089568 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":249,"threads_started":1}
I20260811 12:40:32.090979 8147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:32.072109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:55905)
0811 12:40:32.073114 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:32.073167 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:32.075049 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:32.075800 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:32.075809 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:32.076368 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:32.077020 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:32.077039 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.078147 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.078151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:32.079390 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:32.079402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.080207 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.080215 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:32.080444 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:32.081172 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:32.081201 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:32.083475 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:32.086840 (+ 3365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:32.086849 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:32.086873 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:32.087325 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:32.087727 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:32.087732 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:32.087746 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:32.087947 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:32.088485 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:32.088494 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:32.088931 (+ 437us) client_negotiation.cc:769] Sending connection context
0811 12:40:32.089214 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 12:40:32.089769 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":340,"threads_started":1}
I20260811 12:40:32.092872 8144 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39593
I20260811 12:40:32.093218 8144 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:32.094019 8144 heartbeater.cc:511] Master 127.0.186.126:39593 requested a full tablet report, sending...
I20260811 12:40:32.096397 7926 ts_manager.cc:194] Registered new tserver with Master: a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865)
I20260811 12:40:32.097968 7926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:55905
WARNING: no policy specified for oryx/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab.
Entry for principal oryx/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab.
I20260811 12:40:32.139215 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39593
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:32.497505 8151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:32.497941 8151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:32.498075 8151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:32.506089 8151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:32.506225 8151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:32.506346 8151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:32.517087 8151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:32.518431 8151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:32.519758 8151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:32.533241 8157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:32.533331 8158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:32.533311 8160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:32.534174 8151 server_base.cc:1034] running on GCE node
I20260811 12:40:32.534847 8151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:32.535880 8151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:32.537127 8151 hybrid_clock.cc:648] HybridClock initialized: now 1786452032537070 us; error 45 us; skew 500 ppm
I20260811 12:40:32.537494 8151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:32 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452032, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:32.541066 8151 init.cc:377] Logged in from keytab as oryx/127.0.186.66@KRBTEST.COM (short username oryx)
I20260811 12:40:32.542722 8151 webserver.cc:460] Webserver started at http://127.0.186.66:44729/ using document root <none> and password file <none>
I20260811 12:40:32.543475 8151 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:32.543623 8151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:32.543941 8151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:32.547071 8151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "fb5e8cfc5bc54f3a801eecf84e758b87"
format_stamp: "Formatted at 2026-08-11 12:40:32 on dist-test-slave-qg60"
server_key: "cb87e56e452dc8ef99378fa9bf4c74b5"
server_key_iv: "a708db55216c53d1b790d7c65c9fab3d"
server_key_version: "encryptionkey@0"
I20260811 12:40:32.547890 8151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "fb5e8cfc5bc54f3a801eecf84e758b87"
format_stamp: "Formatted at 2026-08-11 12:40:32 on dist-test-slave-qg60"
server_key: "cb87e56e452dc8ef99378fa9bf4c74b5"
server_key_iv: "a708db55216c53d1b790d7c65c9fab3d"
server_key_version: "encryptionkey@0"
I20260811 12:40:32.553544 8151 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 12:40:32.557480 8170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:32.558966 8151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:32.559264 8151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "fb5e8cfc5bc54f3a801eecf84e758b87"
format_stamp: "Formatted at 2026-08-11 12:40:32 on dist-test-slave-qg60"
server_key: "cb87e56e452dc8ef99378fa9bf4c74b5"
server_key_iv: "a708db55216c53d1b790d7c65c9fab3d"
server_key_version: "encryptionkey@0"
I20260811 12:40:32.559514 8151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:32.579097 8151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:32.583846 8151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:32.584170 8151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:32.585328 8151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:32.586800 8151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:32.586907 8151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:32.587057 8151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:32.587131 8151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:32.625144 8151 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:42959
I20260811 12:40:32.625190 8306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:42959 every 8 connection(s)
I20260811 12:40:32.626649 8151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:32.629573 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 8151
I20260811 12:40:32.629797 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:32.630383 745 external_mini_cluster.cc:1428] Setting key e1adcf446f07e2c5b31da58395665e9f
Aug 11 12:40:32 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452032, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:32.651351 8309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:32.629814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:44457 (local address 127.0.186.126:39593)
0811 12:40:32.630348 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:32.630355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:32.631635 (+ 1280us) server_negotiation.cc:407] Connection header received
0811 12:40:32.633694 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:32.633703 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:32.633810 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:32.633944 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:32.635715 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.636896 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.638789 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.639548 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.639721 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:32.644477 (+ 4756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:32.644482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:32.644486 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:32.644527 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:32.647384 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:32.648426 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:32.648430 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:32.648433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:32.648622 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:32.649181 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:32.649184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:32.649186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:32.649559 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:32.649710 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:32.650762 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0811 12:40:32.651049 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":273,"threads_started":1}
I20260811 12:40:32.653007 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:32.630550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:44457)
0811 12:40:32.631455 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:32.631505 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:32.633394 (+ 1889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:32.634269 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:32.634278 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:32.634879 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:32.635512 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:32.635534 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.637122 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.637127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:32.638626 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:32.638643 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:32.639804 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:32.639809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:32.640085 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:32.641178 (+ 1093us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:32.641208 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:32.644120 (+ 2912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:32.647593 (+ 3473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:32.647606 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:32.647630 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:32.648304 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:32.648765 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:32.648773 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:32.648780 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:32.649057 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:32.649694 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:32.649706 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:32.650235 (+ 529us) client_negotiation.cc:769] Sending connection context
0811 12:40:32.650594 (+ 359us) client_negotiation.cc:240] Negotiation successful
0811 12:40:32.651214 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":375,"threads_started":1}
I20260811 12:40:32.654675 8307 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39593
I20260811 12:40:32.655040 8307 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:32.656011 8307 heartbeater.cc:511] Master 127.0.186.126:39593 requested a full tablet report, sending...
I20260811 12:40:32.657768 7926 ts_manager.cc:194] Registered new tserver with Master: fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959)
I20260811 12:40:32.658638 7926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:44457
WARNING: no policy specified for oryx/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab.
Entry for principal oryx/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab.
I20260811 12:40:32.699863 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39593
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:33.058277 8313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:33.058641 8313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:33.058808 8313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:33.067153 8313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:33.067349 8313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:33.067559 8313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:33.080016 8313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:33.081413 8313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:33.082737 8313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:33.096918 8320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:33.096894 8321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:33.097019 8323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:33.097811 8313 server_base.cc:1034] running on GCE node
I20260811 12:40:33.098501 8313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:33.099632 8313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:33.100834 8313 hybrid_clock.cc:648] HybridClock initialized: now 1786452033100783 us; error 40 us; skew 500 ppm
I20260811 12:40:33.101256 8313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:40:33.101258 8144 heartbeater.cc:503] Master 127.0.186.126:39593 was elected leader, sending a full tablet report...
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452033, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:33.104938 8313 init.cc:377] Logged in from keytab as oryx/127.0.186.67@KRBTEST.COM (short username oryx)
I20260811 12:40:33.106513 8313 webserver.cc:460] Webserver started at http://127.0.186.67:41547/ using document root <none> and password file <none>
I20260811 12:40:33.107242 8313 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:33.107419 8313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:33.107764 8313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:33.111068 8313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "e29264604b4f422292ae945ac3f91c0e"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "887e54295200c3fcba2e0f347337903f"
server_key_iv: "bd7149f1cc4b08ddd89cf691c4e82912"
server_key_version: "encryptionkey@0"
I20260811 12:40:33.111950 8313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "e29264604b4f422292ae945ac3f91c0e"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "887e54295200c3fcba2e0f347337903f"
server_key_iv: "bd7149f1cc4b08ddd89cf691c4e82912"
server_key_version: "encryptionkey@0"
I20260811 12:40:33.117996 8313 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 12:40:33.121984 8331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:33.123476 8313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:40:33.123656 8313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "e29264604b4f422292ae945ac3f91c0e"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "887e54295200c3fcba2e0f347337903f"
server_key_iv: "bd7149f1cc4b08ddd89cf691c4e82912"
server_key_version: "encryptionkey@0"
I20260811 12:40:33.123837 8313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:33.144836 8313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:33.149780 8313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:33.150074 8313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:33.151149 8313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:33.152670 8313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:33.152765 8313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:40:33.152900 8313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:33.152942 8313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:33.190079 8313 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:45863
I20260811 12:40:33.190217 8457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:45863 every 8 connection(s)
I20260811 12:40:33.191469 8313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:33.199807 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 8313
I20260811 12:40:33.200032 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:33.200510 745 external_mini_cluster.cc:1428] Setting key a2547e03782ae9d69004251e591dba15
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452033, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:33.214252 8460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.194429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44203 (local address 127.0.186.126:39593)
0811 12:40:33.194939 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.194943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.195814 (+ 871us) server_negotiation.cc:407] Connection header received
0811 12:40:33.197933 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.197938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.198053 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.198187 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.200051 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.201024 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.203178 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.203702 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.203814 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.207774 (+ 3960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.207780 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.207783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.207820 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.211063 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.211875 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.211880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.211882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.212071 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.212471 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.212474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.212476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.212838 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.212975 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.213679 (+ 704us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.213859 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":277,"threads_started":1}
I20260811 12:40:33.215387 8461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.194849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:44203)
0811 12:40:33.195635 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:33.195677 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:33.197632 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:33.198449 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:33.198458 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:33.199029 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:33.199825 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.199852 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.201206 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.201212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.203009 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.203025 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.203964 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.203972 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.204219 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.205058 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:33.205089 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:33.207441 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:33.211215 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.211223 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.211237 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.211737 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.212175 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.212178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.212180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.212374 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.212961 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:33.212968 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:33.213313 (+ 345us) client_negotiation.cc:769] Sending connection context
0811 12:40:33.213584 (+ 271us) client_negotiation.cc:240] Negotiation successful
0811 12:40:33.214011 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":305,"threads_started":1}
I20260811 12:40:33.216836 8458 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39593
I20260811 12:40:33.217125 8458 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:33.217839 8458 heartbeater.cc:511] Master 127.0.186.126:39593 requested a full tablet report, sending...
I20260811 12:40:33.219264 7926 ts_manager.cc:194] Registered new tserver with Master: e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863)
I20260811 12:40:33.220168 7926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:44203
I20260811 12:40:33.229548 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.0.186.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.125.keytab.
Entry for principal oryx/127.0.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.125.keytab.
I20260811 12:40:33.298311 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:34691
--webserver_interface=127.0.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.125.keytab
--principal=oryx/127.0.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39593,127.0.186.125:34691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:33.661947 8307 heartbeater.cc:503] Master 127.0.186.126:39593 was elected leader, sending a full tablet report...
W20260811 12:40:33.698561 8464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:33.698969 8464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:33.699136 8464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:33.707217 8464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:33.707393 8464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:33.707490 8464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:33.707597 8464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:33.707695 8464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:33.718910 8464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39593,127.0.186.125:34691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.125.keytab
--principal=oryx/127.0.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:34691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
W20260811 12:40:33.719391 8464 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.0.186.126:39593,127.0.186.125:34691'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 12:40:33.720597 8464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:33.722090 8464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:33.735580 8474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:33.735610 8473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:33.735670 8476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:33.736379 8464 server_base.cc:1034] running on GCE node
I20260811 12:40:33.737358 8464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:33.738993 8464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:33.740289 8464 hybrid_clock.cc:648] HybridClock initialized: now 1786452033740215 us; error 41 us; skew 500 ppm
I20260811 12:40:33.740878 8464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452033, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:33.744690 8464 init.cc:377] Logged in from keytab as oryx/127.0.186.125@KRBTEST.COM (short username oryx)
I20260811 12:40:33.746385 8464 webserver.cc:460] Webserver started at http://127.0.186.125:45897/ using document root <none> and password file <none>
I20260811 12:40:33.747196 8464 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:33.747289 8464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:33.747586 8464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:33.751245 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/instance:
uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "52a01b22cbda2b0b0dc3710ecdc68e90"
server_key_iv: "f2e9007619d1edc6b7e64ad888be3ab5"
server_key_version: "encryptionkey@0"
I20260811 12:40:33.752035 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal/instance:
uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "52a01b22cbda2b0b0dc3710ecdc68e90"
server_key_iv: "f2e9007619d1edc6b7e64ad888be3ab5"
server_key_version: "encryptionkey@0"
I20260811 12:40:33.758213 8464 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 12:40:33.762552 8483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:33.764626 8464 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 12:40:33.764871 8464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "52a01b22cbda2b0b0dc3710ecdc68e90"
server_key_iv: "f2e9007619d1edc6b7e64ad888be3ab5"
server_key_version: "encryptionkey@0"
I20260811 12:40:33.765172 8464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:33.788504 8464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:33.793946 8464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:33.794348 8464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:33.817533 8464 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.125:34691
I20260811 12:40:33.817570 8543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.125:34691 every 8 connection(s)
I20260811 12:40:33.819141 8464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
I20260811 12:40:33.822677 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 8464
I20260811 12:40:33.823278 8545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:33.834396 8545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452033, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.125@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:33.853096 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.825337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36866 (local address 127.0.186.125:34691)
0811 12:40:33.826287 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.826302 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.826368 (+ 66us) server_negotiation.cc:407] Connection header received
0811 12:40:33.828901 (+ 2533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.828934 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.829552 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.830045 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.831784 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.833806 (+ 2022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.835556 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.836619 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.836851 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.843589 (+ 6738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.843601 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.843618 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.843674 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.847472 (+ 3798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.848389 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.848399 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.848407 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.848658 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.849209 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.849213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.849215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.850052 (+ 837us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.850397 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.850962 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.851495 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":380,"threads_started":1}
I20260811 12:40:33.857739 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.837699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49012 (local address 127.0.186.126:39593)
0811 12:40:33.838685 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.838689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.841405 (+ 2716us) server_negotiation.cc:407] Connection header received
0811 12:40:33.841690 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.841694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.841764 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.841887 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.843223 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.844421 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.846077 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.846526 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.846690 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.850734 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.850741 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.850746 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.850800 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.854277 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.855262 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.855267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.855271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.855460 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.855952 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.855957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.855960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.856390 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.856565 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.857113 (+ 548us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.857359 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":881,"thread_start_us":722,"threads_started":1}
I20260811 12:40:33.857790 8550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.837803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49012)
0811 12:40:33.841243 (+ 3440us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:33.841292 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:33.841527 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:33.841967 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:33.841975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:33.842756 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:33.843052 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.843064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.844565 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.844573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.845907 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.845920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.846756 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.846763 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.846979 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.847639 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:33.847670 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:33.850512 (+ 2842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:33.854420 (+ 3908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.854430 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.854435 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.855089 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.855649 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.855656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.855659 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.855836 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.856534 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:33.856541 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:33.856791 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 12:40:33.857003 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 12:40:33.857351 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3204,"thread_start_us":3075,"threads_started":1}
I20260811 12:40:33.860667 8545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452033, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.125@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
I20260811 12:40:33.875692 8550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.861573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36876)
0811 12:40:33.861819 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:33.861836 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:33.861936 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:33.862256 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:33.862260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:33.862774 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:33.863073 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.863091 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.864589 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.864594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.865603 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.865616 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.866446 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.866451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.866602 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.867241 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:33.867259 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:33.869859 (+ 2600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:33.873264 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.873268 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.873271 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.873662 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.874178 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.874181 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.874184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.874317 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.874917 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:33.874928 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:33.875064 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 12:40:33.875184 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 12:40:33.875421 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 12:40:33.876078 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.861829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36876 (local address 127.0.186.125:34691)
0811 12:40:33.861988 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.861993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.862008 (+ 15us) server_negotiation.cc:407] Connection header received
0811 12:40:33.862049 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.862053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.862107 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.862187 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.863273 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.864353 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.865753 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.866239 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.866356 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.870109 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.870115 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.870119 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.870155 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.873108 (+ 2953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.873862 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.873867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.873869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.874008 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.874437 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.874441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.874443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.874780 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.874909 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.875292 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.875626 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":54}
I20260811 12:40:33.881250 8545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Bootstrap starting.
I20260811 12:40:33.884537 8545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:33.885829 8545 log.cc:824] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:33.888923 8545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: No bootstrap required, opened a new log
I20260811 12:40:33.896502 8545 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } }
I20260811 12:40:33.897029 8545 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:33.897156 8545 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0a3ab91f0f49a3a239d2d36fe5dfbb, State: Initialized, Role: FOLLOWER
I20260811 12:40:33.897794 8545 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } }
I20260811 12:40:33.898765 8552 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } } }
I20260811 12:40:33.899130 8552 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:40:33.899902 8545 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:40:33.910429 8567 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:40:33.910625 8567 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:40:33.915127 8464 master_runner.cc:428] Detected that this master dc0a3ab91f0f49a3a239d2d36fe5dfbb is joining an existing cluster
I20260811 12:40:33.915278 8464 master_runner.cc:432] Initiating AddMaster RPC to add 127.0.186.125:34691
I20260811 12:40:33.937085 8552 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:33.937826 8552 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } }
I20260811 12:40:33.941625 7936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" is_pre_election: true
I20260811 12:40:33.942831 8552 leader_election.cc:288] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593)
I20260811 12:40:33.943336 8486 leader_election.cc:302] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: dc0a3ab91f0f49a3a239d2d36fe5dfbb; no voters: 4d3c21f28c6d4a458d25e4e8574ffa04
I20260811 12:40:33.944615 8552 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
WARNING: no policy specified for oryx/127.0.186.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.124@KRBTEST.COM" created.
I20260811 12:40:33.964681 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.920776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36884 (local address 127.0.186.125:34691)
0811 12:40:33.921003 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.921010 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.945490 (+ 24480us) server_negotiation.cc:407] Connection header received
0811 12:40:33.945719 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.945725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.946222 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.946348 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.948212 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.949579 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.951843 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.952768 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.952912 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.955811 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.955821 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.955830 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.955907 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.960554 (+ 4647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.961770 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.961777 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.961781 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.962007 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.962504 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.962509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.962513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.962968 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.963147 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.963815 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.964133 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 12:40:33.965937 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.920236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36884)
0811 12:40:33.945347 (+ 25111us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:33.945378 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:33.945569 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:33.946616 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:33.946621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:33.947531 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:33.948028 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.948043 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.949838 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.949844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.951650 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.951669 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.953285 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.953293 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.953483 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.954243 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:33.954270 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:33.955563 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:33.960790 (+ 5227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.960796 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.960801 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.961592 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.962169 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.962173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.962179 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.962372 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.963302 (+ 930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:33.963308 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:33.963481 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 12:40:33.965044 (+ 1563us) client_negotiation.cc:240] Negotiation successful
0811 12:40:33.965407 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24942,"thread_start_us":24710,"threads_started":1}
I20260811 12:40:33.966710 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.921033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49018 (local address 127.0.186.126:39593)
0811 12:40:33.921285 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.921294 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.932023 (+ 10729us) server_negotiation.cc:407] Connection header received
0811 12:40:33.932858 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.932870 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.933028 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.933129 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.935136 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.936529 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.940393 (+ 3864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.941392 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.941558 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.948695 (+ 7137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.948702 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.948705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.948817 (+ 112us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.961543 (+ 12726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.962520 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.962529 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.962535 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.962807 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.963455 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.963464 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.963470 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.964040 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.964192 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.965476 (+ 1284us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.965844 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:40:33.968499 8574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.920106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49018)
0811 12:40:33.931840 (+ 11734us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:33.931876 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:33.932575 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:33.933413 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:33.933422 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:33.934306 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:33.934850 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.934871 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.937122 (+ 2251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.937131 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.940110 (+ 2979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.940169 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.945159 (+ 4990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.945177 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.945435 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.946300 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:33.946331 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:33.948297 (+ 1966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:33.961701 (+ 13404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.961710 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.961717 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.962328 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.962998 (+ 670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.963006 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.963013 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.963232 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.964300 (+ 1068us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:33.964308 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:33.964587 (+ 279us) client_negotiation.cc:769] Sending connection context
0811 12:40:33.967256 (+ 2669us) client_negotiation.cc:240] Negotiation successful
0811 12:40:33.967838 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11494,"thread_start_us":11930,"threads_started":1}
Aug 11 12:40:33 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452031, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.126@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.124.keytab.
Entry for principal oryx/127.0.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.124.keytab.
I20260811 12:40:33.997321 8578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.977290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36894)
0811 12:40:33.978037 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:33.978092 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:33.978361 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:33.979254 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:33.979263 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:33.980313 (+ 1050us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:33.980671 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.980688 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.982589 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.982596 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.984559 (+ 1963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:33.984592 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.985625 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.985632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:33.985858 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.986647 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:33.986667 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:33.989529 (+ 2862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:33.993715 (+ 4186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.993735 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.993745 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.994330 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.994826 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:33.994832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:33.994836 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:33.995029 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:33.995756 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:33.995767 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:33.996049 (+ 282us) client_negotiation.cc:769] Sending connection context
0811 12:40:33.996324 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 12:40:33.996791 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":766,"threads_started":1}
I20260811 12:40:33.997349 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:33.977770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36894 (local address 127.0.186.125:34691)
0811 12:40:33.978036 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:33.978046 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:33.978192 (+ 146us) server_negotiation.cc:407] Connection header received
0811 12:40:33.978636 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:33.978643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:33.978748 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:33.978847 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:33.980955 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.982408 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.984808 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:33.985378 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:33.985569 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:33.989790 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:33.989796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:33.989800 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:33.989840 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:33.993482 (+ 3642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.994493 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.994506 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.994509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.994671 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:33.995166 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:33.995172 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:33.995182 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:33.995557 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:33.995756 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:33.996526 (+ 770us) server_negotiation.cc:299] Negotiation successful
0811 12:40:33.996894 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 12:40:33.997917 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:40917
--webserver_interface=127.0.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.124.keytab
--principal=oryx/127.0.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:34.000114 7926 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.0.186.125:34691: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
member_type: NON_VOTER
last_known_addr {
host: "127.0.186.125"
port: 34691
}
attrs {
promote: true
}
}
dest_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04"
cas_config_opid_index: -1
I20260811 12:40:34.001684 7926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } }
I20260811 12:40:34.013041 8581 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dc0a3ab91f0f49a3a239d2d36fe5dfbb (127.0.186.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } }
I20260811 12:40:34.014530 8515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:34.019039 8515 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Refusing update from remote peer 4d3c21f28c6d4a458d25e4e8574ffa04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 12:40:34.019227 8581 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.0.186.125:34691
I20260811 12:40:34.019908 8580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } }
I20260811 12:40:34.020414 8464 master.cc:537] Master@127.0.186.125:34691 shutting down...
I20260811 12:40:34.020610 8580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:34.020402 8581 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 12:40:34.032186 7909 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 12:40:34.034991 7909 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 -> Peer dc0a3ab91f0f49a3a239d2d36fe5dfbb (127.0.186.125:34691): Couldn't send request to peer dc0a3ab91f0f49a3a239d2d36fe5dfbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 12:40:34.040395 8464 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:34.040884 8464 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:34.041076 8464 tablet_replica.cc:330] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: stopping tablet replica
I20260811 12:40:34.049321 8464 master.cc:552] Master@127.0.186.125:34691 shutdown complete.
I20260811 12:40:34.049491 8464 master_runner.cc:305] Clearing existing system tablet
I20260811 12:40:34.050165 8464 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:34.050287 8464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:34.053783 8464 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 12:40:34.055759 8588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:34.056222 8464 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:34.056635 8464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 12:40:34.056838 8464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "52a01b22cbda2b0b0dc3710ecdc68e90"
server_key_iv: "f2e9007619d1edc6b7e64ad888be3ab5"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.062491 8464 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:34.072985 8464 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 12:40:34.073221 8464 log.cc:1196] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 12:40:34.073784 8464 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Deleting consensus metadata
I20260811 12:40:34.074191 8464 master_runner.cc:315] Copying system tablet from 127.0.186.126:39593
I20260811 12:40:34.082908 8464 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: tablet copy: Beginning tablet copy session from remote peer at address 127.0.186.126:39593
I20260811 12:40:34.102548 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.084193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49034 (local address 127.0.186.126:39593)
0811 12:40:34.084458 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.084467 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.085175 (+ 708us) server_negotiation.cc:407] Connection header received
0811 12:40:34.085477 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.085484 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.085590 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.085717 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.087251 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.088569 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.090739 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.091566 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.091717 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.094511 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.094518 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.094522 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.094566 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.098857 (+ 4291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.099868 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.099874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.099878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.100065 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.100577 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.100583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.100587 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.101056 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.101220 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.101795 (+ 575us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.102061 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 12:40:34.102622 8594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.083923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49034)
0811 12:40:34.084993 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.085029 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.085272 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.085793 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.085802 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.086621 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.087031 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.087054 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.088813 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.088822 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.090552 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.090571 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.091771 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.091782 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.091999 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.092955 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.092984 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.094249 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.099062 (+ 4813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.099074 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.099079 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.099700 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.100205 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.100211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.100215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.100427 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.101212 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.101220 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.101447 (+ 227us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.101624 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.102064 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"thread_start_us":722,"threads_started":1}
I20260811 12:40:34.104151 7948 tablet_copy_service.cc:140] P 4d3c21f28c6d4a458d25e4e8574ffa04: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dc0a3ab91f0f49a3a239d2d36fe5dfbb ({username='oryx', principal='oryx/127.0.186.125@KRBTEST.COM'} at 127.0.0.1:49034)
I20260811 12:40:34.104530 7948 tablet_copy_service.cc:161] P 4d3c21f28c6d4a458d25e4e8574ffa04: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dc0a3ab91f0f49a3a239d2d36fe5dfbb at {username='oryx', principal='oryx/127.0.186.125@KRBTEST.COM'} at 127.0.0.1:49034: session id = dc0a3ab91f0f49a3a239d2d36fe5dfbb-00000000000000000000000000000000
I20260811 12:40:34.108704 7948 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 12:40:34.111414 8464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 12:40:34.119839 8464 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: tablet copy: Starting download of 0 data blocks...
I20260811 12:40:34.120289 8464 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: tablet copy: Starting download of 1 WAL segments...
I20260811 12:40:34.123606 8464 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 12:40:34.128831 7948 tablet_copy_service.cc:342] P 4d3c21f28c6d4a458d25e4e8574ffa04: Request end of tablet copy session dc0a3ab91f0f49a3a239d2d36fe5dfbb-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.0.186.125@KRBTEST.COM'} at 127.0.0.1:49034
I20260811 12:40:34.129073 7948 tablet_copy_service.cc:433] P 4d3c21f28c6d4a458d25e4e8574ffa04: ending tablet copy session dc0a3ab91f0f49a3a239d2d36fe5dfbb-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dc0a3ab91f0f49a3a239d2d36fe5dfbb
I20260811 12:40:34.143662 8464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:34.146872 8596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:34.157286 8597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:34.157532 8599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:34.166601 8464 server_base.cc:1034] running on GCE node
I20260811 12:40:34.167135 8464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:34.168175 8464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:34.169543 8464 hybrid_clock.cc:648] HybridClock initialized: now 1786452034169468 us; error 40 us; skew 500 ppm
I20260811 12:40:34.169867 8464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452034, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:34.172365 8464 init.cc:377] Logged in from keytab as oryx/127.0.186.125@KRBTEST.COM (short username oryx)
I20260811 12:40:34.175806 8464 webserver.cc:460] Webserver started at http://127.0.186.125:39287/ using document root <none> and password file <none>
I20260811 12:40:34.176199 8464 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:34.176293 8464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:34.179885 8464 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 12:40:34.182193 8608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:34.182798 8464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 12:40:34.182960 8464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "52a01b22cbda2b0b0dc3710ecdc68e90"
server_key_iv: "f2e9007619d1edc6b7e64ad888be3ab5"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.183179 8464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:34.217293 8464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:34.222261 8464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:34.222895 8458 heartbeater.cc:503] Master 127.0.186.126:39593 was elected leader, sending a full tablet report...
I20260811 12:40:34.270058 8464 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.125:34691
I20260811 12:40:34.270100 8665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.125:34691 every 8 connection(s)
I20260811 12:40:34.271799 8464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
I20260811 12:40:34.277669 8666 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:40:34.281889 8666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Bootstrap starting.
I20260811 12:40:34.301364 8666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:40:34.302039 8666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: Bootstrap complete.
I20260811 12:40:34.303399 8666 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } }
I20260811 12:40:34.303700 8666 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dc0a3ab91f0f49a3a239d2d36fe5dfbb, State: Initialized, Role: LEARNER
I20260811 12:40:34.304033 8666 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } }
I20260811 12:40:34.305094 8670 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } }
I20260811 12:40:34.305435 8666 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:34.305510 8670 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: LEARNER
I20260811 12:40:34.316021 8683 catalog_manager.cc:1259] Loaded cluster ID: 6e96288315a7474db5368c83256280c6
I20260811 12:40:34.316155 8683 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: loading cluster ID for follower catalog manager: success
I20260811 12:40:34.320225 8683 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: acquiring CA information for follower catalog manager: success
I20260811 12:40:34.323159 8683 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 12:40:34.473711 8583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:34.474119 8583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:34.474284 8583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:34.482558 8583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:34.482725 8583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:34.482833 8583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:34.482944 8583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:34.483022 8583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:34.494047 8583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.124.keytab
--principal=oryx/127.0.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:40917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:34.495597 8583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:34.497215 8583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:34.510528 8689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:34.510496 8690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:34.511117 8692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:34.511977 8583 server_base.cc:1034] running on GCE node
I20260811 12:40:34.512952 8583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:34.514561 8583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:34.515793 8583 hybrid_clock.cc:648] HybridClock initialized: now 1786452034515743 us; error 37 us; skew 500 ppm
I20260811 12:40:34.516193 8583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452034, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:34.520143 8583 init.cc:377] Logged in from keytab as oryx/127.0.186.124@KRBTEST.COM (short username oryx)
I20260811 12:40:34.522025 8583 webserver.cc:460] Webserver started at http://127.0.186.124:43999/ using document root <none> and password file <none>
I20260811 12:40:34.522835 8583 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:34.522989 8583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:34.523350 8583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:34.526973 8583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/instance:
uuid: "fc25b7d657ec4a13a82006ffb09976ef"
format_stamp: "Formatted at 2026-08-11 12:40:34 on dist-test-slave-qg60"
server_key: "712d3728431e8fd061041652a5afabf1"
server_key_iv: "f623b20cc76b08eabf9a4348f8050bd2"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.527971 8583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal/instance:
uuid: "fc25b7d657ec4a13a82006ffb09976ef"
format_stamp: "Formatted at 2026-08-11 12:40:34 on dist-test-slave-qg60"
server_key: "712d3728431e8fd061041652a5afabf1"
server_key_iv: "f623b20cc76b08eabf9a4348f8050bd2"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.534587 8583 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 12:40:34.538498 8704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:34.540087 8583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:40:34.540273 8583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
uuid: "fc25b7d657ec4a13a82006ffb09976ef"
format_stamp: "Formatted at 2026-08-11 12:40:34 on dist-test-slave-qg60"
server_key: "712d3728431e8fd061041652a5afabf1"
server_key_iv: "f623b20cc76b08eabf9a4348f8050bd2"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.540481 8583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:34.571728 8583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:34.577090 8583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:34.577389 8583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:34.598510 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.588872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36902)
0811 12:40:34.589911 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.589944 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.590111 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.590522 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.590526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.590559 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:34.590764 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.590773 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.592552 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.592562 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.595172 (+ 2610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.595194 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.597256 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.597267 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.597564 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.597663 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.597801 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.598024 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":781,"threads_started":1}
I20260811 12:40:34.598567 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.589112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36902 (local address 127.0.186.125:34691)
0811 12:40:34.589757 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.589764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.590166 (+ 402us) server_negotiation.cc:407] Connection header received
0811 12:40:34.590264 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.590269 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.590346 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.590484 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:34.590938 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.592354 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.595447 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.596955 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.597178 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.597497 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.597853 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.598075 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":333,"threads_started":1}
I20260811 12:40:34.600390 8638 raft_consensus.cc:1203] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260811 12:40:34.601243 8670 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d3c21f28c6d4a458d25e4e8574ffa04. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } }
I20260811 12:40:34.601542 8670 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: LEARNER
I20260811 12:40:34.601524 8583 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.124:40917
I20260811 12:40:34.601528 8765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.124:40917 every 8 connection(s)
I20260811 12:40:34.603204 8583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
I20260811 12:40:34.608080 8766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:34.613188 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 8583
I20260811 12:40:34.617084 8766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452034, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.124@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.124@KRBTEST.COM
I20260811 12:40:34.640697 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.620702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49040 (local address 127.0.186.126:39593)
0811 12:40:34.621305 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.621312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.621969 (+ 657us) server_negotiation.cc:407] Connection header received
0811 12:40:34.622110 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.622117 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.622204 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.622348 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.623597 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.624691 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.626406 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.626952 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.627080 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.632219 (+ 5139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.632225 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.632228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.632270 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.636097 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.637306 (+ 1209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.637313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.637319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.637555 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.638260 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.638269 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.638272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.638690 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.638810 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.639940 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.640209 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":268,"threads_started":1}
I20260811 12:40:34.642127 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.620660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49040)
0811 12:40:34.621704 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.621750 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.621943 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.622420 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.622425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.623013 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.623382 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.623439 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.624893 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.624900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.626253 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.626266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.627228 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.627235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.627618 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.628521 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.628557 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.631827 (+ 3270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.636300 (+ 4473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.636316 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.636341 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.637160 (+ 819us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.637702 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.637705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.637708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.638114 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.638825 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.638836 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.639405 (+ 569us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.639785 (+ 380us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.640431 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"mutex_wait_us":116,"spinlock_wait_cycles":42240,"thread_start_us":595,"threads_started":1}
I20260811 12:40:34.642148 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.616216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37632 (local address 127.0.186.124:40917)
0811 12:40:34.617582 (+ 1366us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.617599 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.618210 (+ 611us) server_negotiation.cc:407] Connection header received
0811 12:40:34.620734 (+ 2524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.620783 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.621387 (+ 604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.621834 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.623497 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.624893 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.626803 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.627716 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.627893 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.633258 (+ 5365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.633269 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.633284 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.633323 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.636863 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.637835 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.637844 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.637846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.638032 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.638571 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.638575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.638577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.639402 (+ 825us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.639822 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.640136 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.640556 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":211,"server-negotiator.queue_time_us":1076,"spinlock_wait_cycles":1920,"thread_start_us":798,"threads_started":1}
I20260811 12:40:34.644075 8766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452034, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.124@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
I20260811 12:40:34.659471 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.645230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.0.186.125:34691)
0811 12:40:34.645444 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.645452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.645670 (+ 218us) server_negotiation.cc:407] Connection header received
0811 12:40:34.646029 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.646034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.646105 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.646189 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.647052 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.647960 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.649507 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.649999 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.650104 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.653794 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.653799 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.653803 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.653842 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.656874 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.657679 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.657683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.657686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.657830 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.658249 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.658252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.658254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.658540 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.658683 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.659003 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.659222 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 12:40:34.659472 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.645083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36918)
0811 12:40:34.645560 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.645585 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.645797 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.646261 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.646265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.646702 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.646864 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.646873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.648106 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.648110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.649326 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.649339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.650173 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.650178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.650363 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.651064 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.651084 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.653555 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.657071 (+ 3516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.657075 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.657078 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.657532 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.657933 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.657936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.657938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.658138 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.658645 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.658648 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.658786 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.658897 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.659199 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 12:40:34.660910 8766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452034, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.124@KRBTEST.COM for oryx/127.0.186.124@KRBTEST.COM
I20260811 12:40:34.675061 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.661690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.0.1:37644)
0811 12:40:34.661902 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.661924 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.662117 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.662435 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.662439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.662864 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.663054 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.663089 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.664221 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.664226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.665366 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.665379 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.666187 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.666193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.666381 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.667020 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.667038 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.669363 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.672711 (+ 3348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.672714 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.672717 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.673175 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.673548 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.673551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.673553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.673746 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.674257 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.674260 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.674387 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.674497 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.674731 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 12:40:34.675153 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.661722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37644 (local address 127.0.186.124:40917)
0811 12:40:34.661902 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.661910 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.661998 (+ 88us) server_negotiation.cc:407] Connection header received
0811 12:40:34.662240 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.662245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.662313 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.662417 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.663211 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.664089 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.665536 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.666009 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.666158 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.669585 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.669597 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.669605 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.669658 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.672565 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.673294 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.673298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.673301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.673446 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.673855 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.673858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.673860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.674155 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.674274 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.674615 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.674857 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":52}
I20260811 12:40:34.680568 8766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Bootstrap starting.
I20260811 12:40:34.684324 8766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:34.685614 8766 log.cc:824] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:34.688686 8766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: No bootstrap required, opened a new log
I20260811 12:40:34.697037 8766 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } }
I20260811 12:40:34.697425 8766 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:34.697602 8766 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc25b7d657ec4a13a82006ffb09976ef, State: Initialized, Role: FOLLOWER
I20260811 12:40:34.698293 8766 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } }
I20260811 12:40:34.699312 8776 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } } }
I20260811 12:40:34.699698 8776 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:40:34.700501 8766 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:40:34.711716 8790 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:40:34.711908 8790 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:40:34.715667 8583 master_runner.cc:428] Detected that this master fc25b7d657ec4a13a82006ffb09976ef is joining an existing cluster
I20260811 12:40:34.715834 8583 master_runner.cc:432] Initiating AddMaster RPC to add 127.0.186.124:40917
I20260811 12:40:34.746659 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.720914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49052 (local address 127.0.186.126:39593)
0811 12:40:34.721141 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.721149 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.725434 (+ 4285us) server_negotiation.cc:407] Connection header received
0811 12:40:34.725771 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.725778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.725894 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.725976 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.728056 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.729611 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.732645 (+ 3034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.733595 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.733729 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.737489 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.737496 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.737502 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.737551 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.741879 (+ 4328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.743035 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.743044 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.743047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.743243 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.744090 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.744098 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.744102 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.744605 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.744962 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.745885 (+ 923us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.746232 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 12:40:34.748577 8796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.720330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49052)
0811 12:40:34.725300 (+ 4970us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.725322 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.725584 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.726276 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.726288 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.727253 (+ 965us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.727845 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.727861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.729984 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.729996 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.732401 (+ 2405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.732421 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.734129 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.734139 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.734838 (+ 699us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.735691 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.735715 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.737253 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.742235 (+ 4982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.742243 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.742250 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.742835 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.743425 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.743431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.743435 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.743817 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.745084 (+ 1267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.745094 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.745485 (+ 391us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.747246 (+ 1761us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.747648 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4817,"mutex_wait_us":150,"thread_start_us":4643,"threads_started":1}
I20260811 12:40:34.750286 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7995
I20260811 12:40:34.752681 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.725619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37646 (local address 127.0.186.124:40917)
0811 12:40:34.725780 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.725784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.735353 (+ 9569us) server_negotiation.cc:407] Connection header received
0811 12:40:34.735598 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.735604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.735685 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.735754 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.737320 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.738557 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.740687 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.741527 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.741689 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.744634 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.744640 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.744645 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.744682 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.748498 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.750422 (+ 1924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.750427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.750430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.750566 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.750988 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.750995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.751004 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.751392 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.751538 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.752063 (+ 525us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.752306 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 12:40:34.753731 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.725897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.0.1:37646)
0811 12:40:34.735262 (+ 9365us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.735283 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.735451 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.735963 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.735968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.736714 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.737158 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.737173 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.738797 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.738805 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.740522 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.740539 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.742124 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.742132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.742463 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.743182 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.743206 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.744423 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.749786 (+ 5363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.749791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.749794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.750294 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.750708 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.750712 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.750715 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.750860 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.751604 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.751610 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.751778 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.752940 (+ 1162us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.753217 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9180,"thread_start_us":8818,"threads_started":1}
I20260811 12:40:34.757673 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.720693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36920)
0811 12:40:34.727653 (+ 6960us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.727677 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.728191 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.728940 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.728947 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.729813 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.730464 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.730483 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.732176 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.732182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.734402 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.734421 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.735818 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.735826 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.736071 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.736924 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.736950 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.738362 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.751165 (+ 12803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.751170 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.751173 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.753062 (+ 1889us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.755239 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.755245 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.755249 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.755531 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.756393 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.756399 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.756642 (+ 243us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.756813 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.757183 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6787,"mutex_wait_us":3,"thread_start_us":7073,"threads_started":1}
I20260811 12:40:34.758731 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.720420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36920 (local address 127.0.186.125:34691)
0811 12:40:34.720670 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.720680 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.727785 (+ 7105us) server_negotiation.cc:407] Connection header received
0811 12:40:34.728405 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.728413 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.728510 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.728602 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.730689 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.731969 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.734611 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.735378 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.735523 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.738617 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.738625 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.738631 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.738683 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.748968 (+ 10285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.754849 (+ 5881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.754858 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.754864 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.755067 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.755692 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.755697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.755702 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.756151 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.756324 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.758035 (+ 1711us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.758340 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452031, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.126@KRBTEST.COM for oryx/127.0.186.124@KRBTEST.COM
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.65@KRBTEST.COM
I20260811 12:40:34.774034 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.751828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57760 (local address 127.0.186.65:37865)
0811 12:40:34.752605 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.752614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.752644 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:40:34.752711 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.752720 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.753436 (+ 716us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.755811 (+ 2375us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.756687 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.758527 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.760652 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.761615 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.761751 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.767001 (+ 5250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.767016 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.767031 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.767068 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.770427 (+ 3359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.771253 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.771266 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.771269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.771441 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.772001 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.772007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.772011 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.772500 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.772883 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.773279 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.773565 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":720,"threads_started":1}
I20260811 12:40:34.774385 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.756215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.0.1:37654)
0811 12:40:34.756375 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.756395 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.756515 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.757038 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.757044 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.757523 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.757737 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.757751 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.759817 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.759826 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.761073 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.761087 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.762037 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.762043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.762254 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.762928 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.762957 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.766523 (+ 3566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.771192 (+ 4669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.771197 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.771200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.771754 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.772205 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.772217 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.772220 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.772358 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.773249 (+ 891us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.773254 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.773442 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.773587 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.774018 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 12:40:34.775408 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.756403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.0.186.124:40917)
0811 12:40:34.756583 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.756588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.756605 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:40:34.756690 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.756696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.756852 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.758141 (+ 1289us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.758332 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.759644 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.761217 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.761881 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.762015 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.766755 (+ 4740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.766763 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.766769 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.766810 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.771010 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.771892 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.771897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.771901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.772047 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.772487 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.772493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.772496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.773077 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.774680 (+ 1603us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.774804 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.775091 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 12:40:34.775882 8139 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:34.777432 7926 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.0.186.124:40917: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef"
member_type: NON_VOTER
last_known_addr {
host: "127.0.186.124"
port: 40917
}
attrs {
promote: true
}
}
dest_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04"
cas_config_opid_index: 5
I20260811 12:40:34.778529 7926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } }
I20260811 12:40:34.780503 8726 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.781481 8638 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 LEARNER]: Refusing update from remote peer 4d3c21f28c6d4a458d25e4e8574ffa04: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 12:40:34.783617 8736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:34.789826 8736 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Refusing update from remote peer 4d3c21f28c6d4a458d25e4e8574ffa04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 12:40:34.795161 8804 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 12:40:34.804519 8726 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.0.186.124:40917
I20260811 12:40:34.804164 8638 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.804180 8803 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 12:40:34.805362 8583 master.cc:537] Master@127.0.186.124:40917 shutting down...
I20260811 12:40:34.807585 8804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.807979 8804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:34.821341 8670 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: NON_VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: true } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.821732 8670 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: LEARNER
W20260811 12:40:34.821777 7907 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 -> Peer fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124:40917): Couldn't send request to peer fc25b7d657ec4a13a82006ffb09976ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 12:40:34.822929 8804 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: attempting to promote NON_VOTER dc0a3ab91f0f49a3a239d2d36fe5dfbb to VOTER
I20260811 12:40:34.823984 8804 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } }
I20260811 12:40:34.826989 8638 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 LEARNER]: Refusing update from remote peer 4d3c21f28c6d4a458d25e4e8574ffa04: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260811 12:40:34.827060 7907 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 -> Peer fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124:40917): Couldn't send request to peer fc25b7d657ec4a13a82006ffb09976ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 12:40:34.827728 8726 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 12:40:34.829715 8710 tablet.cc:2369] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:34.830717 8803 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dc0a3ab91f0f49a3a239d2d36fe5dfbb (127.0.186.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.831503 8638 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dc0a3ab91f0f49a3a239d2d36fe5dfbb (127.0.186.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.835289 8801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.835747 8801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:34.836083 8801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.836304 8801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:34.836210 8670 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:34.836467 8670 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:40:34.847951 8583 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:34.848477 8583 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:34.848714 8583 tablet_replica.cc:330] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: stopping tablet replica
I20260811 12:40:34.856252 8583 master.cc:552] Master@127.0.186.124:40917 shutdown complete.
I20260811 12:40:34.856434 8583 master_runner.cc:305] Clearing existing system tablet
I20260811 12:40:34.856984 8583 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:34.857194 8583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:34.860473 8583 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 12:40:34.862540 8809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:34.862998 8583 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:34.863514 8583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 12:40:34.863699 8583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
uuid: "fc25b7d657ec4a13a82006ffb09976ef"
format_stamp: "Formatted at 2026-08-11 12:40:34 on dist-test-slave-qg60"
server_key: "712d3728431e8fd061041652a5afabf1"
server_key_iv: "f623b20cc76b08eabf9a4348f8050bd2"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.869926 8583 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:34.877722 8583 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 12:40:34.878080 8583 log.cc:1196] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 12:40:34.878711 8583 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Deleting consensus metadata
I20260811 12:40:34.879074 8583 master_runner.cc:315] Copying system tablet from 127.0.186.126:39593
I20260811 12:40:34.881987 8583 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: tablet copy: Beginning tablet copy session from remote peer at address 127.0.186.126:39593
I20260811 12:40:34.902037 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.883014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49056 (local address 127.0.186.126:39593)
0811 12:40:34.883267 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:34.883273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:34.885382 (+ 2109us) server_negotiation.cc:407] Connection header received
0811 12:40:34.885689 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:34.885696 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:34.885798 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:34.885873 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:34.887241 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.888405 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.890439 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.891129 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.891230 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.894485 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:34.894492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:34.894497 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:34.894543 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:34.898432 (+ 3889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.899355 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.899362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.899366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.899547 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:34.900055 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:34.900060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:34.900064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:34.900468 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:34.900624 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:34.901362 (+ 738us) server_negotiation.cc:299] Negotiation successful
0811 12:40:34.901628 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260811 12:40:34.902644 8816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:34.882938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49056)
0811 12:40:34.885251 (+ 2313us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:34.885275 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:34.885519 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:34.886117 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:34.886122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:34.886737 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:34.887031 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.887046 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.888636 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.888642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.890256 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:34.890271 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:34.891554 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:34.891560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:34.892117 (+ 557us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:34.892994 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:34.893020 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:34.894226 (+ 1206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:34.898626 (+ 4400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.898632 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.898636 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.899194 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.899708 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:34.899719 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:34.899723 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:34.899905 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:34.900720 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:34.900778 (+ 58us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:34.901036 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 12:40:34.901785 (+ 749us) client_negotiation.cc:240] Negotiation successful
0811 12:40:34.902202 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2152,"thread_start_us":1939,"threads_started":1}
I20260811 12:40:34.903247 7948 tablet_copy_service.cc:140] P 4d3c21f28c6d4a458d25e4e8574ffa04: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fc25b7d657ec4a13a82006ffb09976ef ({username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:49056)
I20260811 12:40:34.903438 7948 tablet_copy_service.cc:161] P 4d3c21f28c6d4a458d25e4e8574ffa04: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fc25b7d657ec4a13a82006ffb09976ef at {username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:49056: session id = fc25b7d657ec4a13a82006ffb09976ef-00000000000000000000000000000000
I20260811 12:40:34.907269 7948 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 12:40:34.909425 8583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 12:40:34.917037 8583 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: tablet copy: Starting download of 0 data blocks...
I20260811 12:40:34.917405 8583 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: tablet copy: Starting download of 1 WAL segments...
I20260811 12:40:34.920148 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7995
I20260811 12:40:34.920209 8583 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 12:40:34.925024 7948 tablet_copy_service.cc:342] P 4d3c21f28c6d4a458d25e4e8574ffa04: Request end of tablet copy session fc25b7d657ec4a13a82006ffb09976ef-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:49056
I20260811 12:40:34.925192 7948 tablet_copy_service.cc:433] P 4d3c21f28c6d4a458d25e4e8574ffa04: ending tablet copy session fc25b7d657ec4a13a82006ffb09976ef-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fc25b7d657ec4a13a82006ffb09976ef
I20260811 12:40:34.938570 8583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:34.941498 8819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:34.947633 8820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:34.951063 8823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:34.951150 8583 server_base.cc:1034] running on GCE node
I20260811 12:40:34.951421 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:37865
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:39593
--webserver_port=44951
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:34.952173 8583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:34.953001 8583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:34.954298 8583 hybrid_clock.cc:648] HybridClock initialized: now 1786452034954256 us; error 38 us; skew 500 ppm
I20260811 12:40:34.954666 8583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:34 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452034, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:34.957316 8583 init.cc:377] Logged in from keytab as oryx/127.0.186.124@KRBTEST.COM (short username oryx)
I20260811 12:40:34.961190 8583 webserver.cc:460] Webserver started at http://127.0.186.124:35195/ using document root <none> and password file <none>
I20260811 12:40:34.961572 8583 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:34.961687 8583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:34.965195 8583 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 12:40:34.970162 8832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:34.970690 8583 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260811 12:40:34.970849 8583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
uuid: "fc25b7d657ec4a13a82006ffb09976ef"
format_stamp: "Formatted at 2026-08-11 12:40:34 on dist-test-slave-qg60"
server_key: "712d3728431e8fd061041652a5afabf1"
server_key_iv: "f623b20cc76b08eabf9a4348f8050bd2"
server_key_version: "encryptionkey@0"
I20260811 12:40:34.971060 8583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:34.988613 8583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:34.993245 8583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:35.022841 8583 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.124:40917
I20260811 12:40:35.022869 8889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.124:40917 every 8 connection(s)
I20260811 12:40:35.024004 8583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
I20260811 12:40:35.029275 8890 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:40:35.033300 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Bootstrap starting.
I20260811 12:40:35.053727 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:40:35.054363 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Bootstrap complete.
I20260811 12:40:35.055611 8890 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } }
I20260811 12:40:35.055948 8890 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fc25b7d657ec4a13a82006ffb09976ef, State: Initialized, Role: LEARNER
I20260811 12:40:35.056214 8890 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } }
I20260811 12:40:35.057397 8890 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:35.057825 8893 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:35.058408 8893 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: This master's current role is: LEARNER
I20260811 12:40:35.083858 8905 catalog_manager.cc:1259] Loaded cluster ID: 6e96288315a7474db5368c83256280c6
I20260811 12:40:35.083989 8905 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: loading cluster ID for follower catalog manager: success
I20260811 12:40:35.087999 8905 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: acquiring CA information for follower catalog manager: success
I20260811 12:40:35.090751 8905 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:40:35.342154 8908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.333194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37668 (local address 127.0.186.124:40917)
0811 12:40:35.335079 (+ 1885us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:35.335084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:35.335102 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:40:35.335168 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:35.335172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:35.335252 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:35.335357 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:35.336070 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.337405 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.340041 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.340984 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.341104 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.341286 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:35.341655 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 12:40:35.341809 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1760,"thread_start_us":1610,"threads_started":1}
I20260811 12:40:35.342213 8906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.333092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.0.1:37668)
0811 12:40:35.334289 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:35.334320 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:35.334519 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:35.335474 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:35.335480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:35.335525 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:35.335907 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.335921 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.337589 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.337596 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.339806 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.339827 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.341198 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.341206 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.341451 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.341491 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 12:40:35.341611 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 12:40:35.341777 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"thread_start_us":276,"threads_started":1}
I20260811 12:40:35.343603 8861 raft_consensus.cc:1203] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 12:40:35.344466 8893 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d3c21f28c6d4a458d25e4e8574ffa04. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:35.344838 8893 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: This master's current role is: LEARNER
W20260811 12:40:35.376117 8830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:35.376461 8830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:35.376642 8830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:35.385526 8830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:35.385680 8830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:35.385881 8830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:35.397194 8830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:37865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=44951
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:35.399014 8830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:35.400442 8830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:35.420106 8913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:35.421008 8914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:35.421429 8916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:35.423164 8830 server_base.cc:1034] running on GCE node
I20260811 12:40:35.424012 8830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:35.425243 8830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:35.426491 8830 hybrid_clock.cc:648] HybridClock initialized: now 1786452035426439 us; error 44 us; skew 500 ppm
I20260811 12:40:35.426864 8830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:35 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452035, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:35.430876 8830 init.cc:377] Logged in from keytab as oryx/127.0.186.65@KRBTEST.COM (short username oryx)
I20260811 12:40:35.432557 8830 webserver.cc:460] Webserver started at http://127.0.186.65:44951/ using document root <none> and password file <none>
I20260811 12:40:35.433384 8830 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:35.433512 8830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:35.439448 8830 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 12:40:35.442579 8928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:35.444042 8830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:40:35.444232 8830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "a6bb570a462642a689a72ca6ae0711f6"
format_stamp: "Formatted at 2026-08-11 12:40:31 on dist-test-slave-qg60"
server_key: "9c48e9e87784a218921841cd5068407a"
server_key_iv: "29f8060c2b344b2e2d340d7674ad3100"
server_key_version: "encryptionkey@0"
I20260811 12:40:35.445389 8830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:35.463975 8830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:35.469537 8830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:35.469862 8830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:35.471434 8830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:35.473047 8830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:35.473142 8830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:35.473301 8830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:35.473413 8830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:35.524300 8830 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:37865
I20260811 12:40:35.524425 9058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:37865 every 8 connection(s)
I20260811 12:40:35.525985 8830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:35.530083 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 8830
I20260811 12:40:35.530359 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 8151
Aug 11 12:40:35 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.66@KRBTEST.COM
Aug 11 12:40:35 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452035, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.124@KRBTEST.COM
Aug 11 12:40:35 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452035, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
Aug 11 12:40:35 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452035, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
I20260811 12:40:35.576282 8908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.529804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:45607 (local address 127.0.186.124:40917)
0811 12:40:35.530061 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:35.530066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:35.545287 (+ 15221us) server_negotiation.cc:407] Connection header received
0811 12:40:35.549952 (+ 4665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:35.549958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:35.550051 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:35.550135 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:35.553759 (+ 3624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.555141 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.559506 (+ 4365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.560284 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.560382 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.566836 (+ 6454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:35.566842 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:35.566845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:35.566885 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:35.571376 (+ 4491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.572489 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.572495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.572498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.572665 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.573432 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.573450 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.573455 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.573901 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:35.574087 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:35.575315 (+ 1228us) server_negotiation.cc:299] Negotiation successful
0811 12:40:35.575832 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:40:35.577689 9071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.537768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:48477 (local address 127.0.186.125:34691)
0811 12:40:35.549639 (+ 11871us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:35.549646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:35.550469 (+ 823us) server_negotiation.cc:407] Connection header received
0811 12:40:35.550549 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:35.550554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:35.550687 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:35.550805 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:35.554369 (+ 3564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.555760 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.558944 (+ 3184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.559724 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.559915 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.568255 (+ 8340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:35.568279 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:35.568287 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:35.568347 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:35.573098 (+ 4751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.574370 (+ 1272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.574377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.574382 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.574583 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.575245 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.575251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.575254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.575751 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:35.575907 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:35.577005 (+ 1098us) server_negotiation.cc:299] Negotiation successful
0811 12:40:35.577252 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11735,"thread_start_us":14568,"threads_started":1}
I20260811 12:40:35.578517 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.550006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:35323 (local address 127.0.186.126:39593)
0811 12:40:35.553368 (+ 3362us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:35.553374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:35.554017 (+ 643us) server_negotiation.cc:407] Connection header received
0811 12:40:35.554090 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:35.554095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:35.554199 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:35.554319 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:35.556173 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.557555 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.560268 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.561105 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.561241 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.567255 (+ 6014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:35.567262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:35.567267 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:35.567343 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:35.573560 (+ 6217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.574659 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.574666 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.574672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.574839 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.575657 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.575662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.575665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.576191 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:35.576356 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:35.577748 (+ 1392us) server_negotiation.cc:299] Negotiation successful
0811 12:40:35.578020 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3237,"thread_start_us":3082,"threads_started":1}
I20260811 12:40:35.578933 9069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.531836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.186.65:45607)
0811 12:40:35.545019 (+ 13183us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:35.545097 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:35.549515 (+ 4418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:35.550949 (+ 1434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:35.550967 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:35.552270 (+ 1303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:35.553515 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.553545 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.555403 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.555408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.559333 (+ 3925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.559348 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.560757 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.560768 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.561242 (+ 474us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.562422 (+ 1180us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:35.562463 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:35.566532 (+ 4069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:35.571574 (+ 5042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:35.571584 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:35.571603 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:35.572339 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:35.572875 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:35.572880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:35.572883 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:35.573280 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:35.574219 (+ 939us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:35.574228 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:35.574795 (+ 567us) client_negotiation.cc:769] Sending connection context
0811 12:40:35.576552 (+ 1757us) client_negotiation.cc:240] Negotiation successful
0811 12:40:35.577494 (+ 942us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12632,"mutex_wait_us":392,"thread_start_us":17192,"threads_started":1}
I20260811 12:40:35.579077 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.531503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36108 (local address 127.0.186.66:42959)
0811 12:40:35.544014 (+ 12511us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:35.544029 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:35.548422 (+ 4393us) server_negotiation.cc:407] Connection header received
0811 12:40:35.548672 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:35.548691 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:35.549128 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:35.549372 (+ 244us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:35.552658 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.554577 (+ 1919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.557023 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.558225 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.558365 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.568351 (+ 9986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:35.568375 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:35.568396 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:35.568445 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:35.573645 (+ 5200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.574845 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.574854 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.574857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.575077 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:35.575733 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:35.575739 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:35.575760 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:35.576237 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:35.577984 (+ 1747us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:35.578251 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 12:40:35.578538 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12227,"thread_start_us":13824,"threads_started":1}
I20260811 12:40:35.580152 9073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.552603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:35323)
0811 12:40:35.553713 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:35.553733 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:35.553850 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:35.554490 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:35.554495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:35.555237 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:35.555940 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.555959 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.557719 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.557724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.560052 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.560067 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.561712 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.561726 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.562040 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.562704 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:35.562732 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:35.566979 (+ 4247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:35.573732 (+ 6753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:35.573737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:35.573741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:35.574504 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:35.575125 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:35.575133 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:35.575140 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:35.575488 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:35.576435 (+ 947us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:35.576440 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:35.576642 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 12:40:35.576878 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 12:40:35.577275 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":968,"thread_start_us":783,"threads_started":1}
I20260811 12:40:35.580893 9066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:35.537027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.186.65:48477)
0811 12:40:35.550029 (+ 13002us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:35.550054 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:35.550210 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:35.551232 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:35.551240 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:35.552270 (+ 1030us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:35.554195 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.554209 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.555960 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.555966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.558794 (+ 2828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:35.558806 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:35.560468 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:35.560491 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:35.561241 (+ 750us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:35.562284 (+ 1043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:35.562337 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:35.567969 (+ 5632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:35.573357 (+ 5388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:35.573364 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:35.573371 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:35.574195 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:35.574736 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:35.574743 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:35.574749 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:35.574951 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:35.576000 (+ 1049us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:35.576004 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:35.576161 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 12:40:35.578197 (+ 2036us) client_negotiation.cc:240] Negotiation successful
0811 12:40:35.578563 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12828,"mutex_wait_us":1664,"spinlock_wait_cycles":18176,"thread_start_us":7265,"threads_started":1}
I20260811 12:40:35.581063 8301 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:35.581344 9060 heartbeater.cc:347] Connected to a master server at 127.0.186.124:40917
I20260811 12:40:35.581760 9060 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:35.582029 9061 heartbeater.cc:347] Connected to a master server at 127.0.186.125:34691
I20260811 12:40:35.582178 9061 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:35.582571 9059 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39593
I20260811 12:40:35.582738 9059 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:35.584658 9060 heartbeater.cc:511] Master 127.0.186.124:40917 requested a full tablet report, sending...
I20260811 12:40:35.585760 9061 heartbeater.cc:511] Master 127.0.186.125:34691 requested a full tablet report, sending...
I20260811 12:40:35.586172 9059 heartbeater.cc:511] Master 127.0.186.126:39593 requested a full tablet report, sending...
I20260811 12:40:35.587457 7926 ts_manager.cc:194] Re-registered known tserver with Master: a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865)
I20260811 12:40:35.588310 7926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:35323
I20260811 12:40:35.588495 8849 ts_manager.cc:194] Registered new tserver with Master: a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865)
I20260811 12:40:35.590308 8628 ts_manager.cc:194] Registered new tserver with Master: a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865)
I20260811 12:40:35.675176 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 8151
I20260811 12:40:35.697532 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:42959
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:39593
--webserver_port=44729
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:35.895548 8804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: NON_VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: true } } }
I20260811 12:40:35.896030 8804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:35.898228 9078 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: attempting to promote NON_VOTER fc25b7d657ec4a13a82006ffb09976ef to VOTER
I20260811 12:40:35.899022 9078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } }
I20260811 12:40:35.901643 8861 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 LEARNER]: Refusing update from remote peer 4d3c21f28c6d4a458d25e4e8574ffa04: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 12:40:35.901741 8638 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Refusing update from remote peer 4d3c21f28c6d4a458d25e4e8574ffa04: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 12:40:35.902318 8804 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 12:40:35.902729 9077 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 12:40:35.906239 8804 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.907859 8861 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.909796 8638 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.911181 8804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.911586 8804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:35.912014 9078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.912314 9078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:35.912747 9078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.913154 9078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:35.917371 9084 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.917960 9084 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:40:35.918742 9083 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:35.919188 9083 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: This master's current role is: FOLLOWER
W20260811 12:40:36.069492 9076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:36.069900 9076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:36.070088 9076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:36.078083 9076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:36.078254 9076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:36.078477 9076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:36.089211 9076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:42959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=44729
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:36.090561 9076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:36.092042 9076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:36.106106 9090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:36.106173 9091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:36.106053 9093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:36.107793 9076 server_base.cc:1034] running on GCE node
I20260811 12:40:36.108532 9076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:36.109732 9076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:36.110966 9076 hybrid_clock.cc:648] HybridClock initialized: now 1786452036110907 us; error 62 us; skew 500 ppm
I20260811 12:40:36.111316 9076 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:36.114797 9076 init.cc:377] Logged in from keytab as oryx/127.0.186.66@KRBTEST.COM (short username oryx)
I20260811 12:40:36.116447 9076 webserver.cc:460] Webserver started at http://127.0.186.66:44729/ using document root <none> and password file <none>
I20260811 12:40:36.117241 9076 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:36.117409 9076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:36.122895 9076 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 12:40:36.125695 9101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:36.127177 9076 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:36.127367 9076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "fb5e8cfc5bc54f3a801eecf84e758b87"
format_stamp: "Formatted at 2026-08-11 12:40:32 on dist-test-slave-qg60"
server_key: "cb87e56e452dc8ef99378fa9bf4c74b5"
server_key_iv: "a708db55216c53d1b790d7c65c9fab3d"
server_key_version: "encryptionkey@0"
I20260811 12:40:36.128439 9076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:36.143337 9076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:36.147616 9076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:36.147895 9076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:36.149035 9076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:36.150736 9076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:36.150861 9076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:36.151002 9076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:36.151106 9076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:36.188344 9076 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:42959
I20260811 12:40:36.188436 9226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:42959 every 8 connection(s)
I20260811 12:40:36.190078 9076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:36.199572 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 9076
I20260811 12:40:36.199986 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 8313
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.124@KRBTEST.COM
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.67@KRBTEST.COM
I20260811 12:40:36.239722 9234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.195629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:51479 (local address 127.0.186.126:39593)
0811 12:40:36.210192 (+ 14563us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.210197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.214573 (+ 4376us) server_negotiation.cc:407] Connection header received
0811 12:40:36.214891 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.214897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.214998 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.215084 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.216661 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.217885 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.220331 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.221131 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.221233 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.228096 (+ 6863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.228103 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.228108 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.228173 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.234065 (+ 5892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.235361 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.235367 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.235371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.235664 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.236439 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.236458 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.236462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.237152 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.237343 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.238865 (+ 1522us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.239188 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14440,"thread_start_us":14354,"threads_started":1}
I20260811 12:40:36.242129 9230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.193280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:54045 (local address 127.0.186.124:40917)
0811 12:40:36.193927 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.193937 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.194956 (+ 1019us) server_negotiation.cc:407] Connection header received
0811 12:40:36.198768 (+ 3812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.198776 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.198885 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.213031 (+ 14146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.215966 (+ 2935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.217407 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.220649 (+ 3242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.221387 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.221502 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.230628 (+ 9126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.230638 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.230646 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.230702 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.237538 (+ 6836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.238686 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.238691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.238694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.238917 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.239470 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.239475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.239478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.239919 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.240052 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.241386 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.241666 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":314,"threads_started":1}
I20260811 12:40:36.242549 9231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.193871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.186.66:54045)
0811 12:40:36.194771 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:36.194823 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:36.198222 (+ 3399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:36.213420 (+ 15198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:36.213436 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:36.214602 (+ 1166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:36.215656 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.215707 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.217644 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.217649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.220446 (+ 2797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.220472 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.222517 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.222528 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.222738 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.223851 (+ 1113us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:36.223874 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:36.228245 (+ 4371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:36.237708 (+ 9463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.237714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.237718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.238494 (+ 776us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.239072 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.239077 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.239081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.239323 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.240127 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:36.240134 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:36.240400 (+ 266us) client_negotiation.cc:769] Sending connection context
0811 12:40:36.240584 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 12:40:36.240948 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":590,"spinlock_wait_cycles":5632,"thread_start_us":396,"threads_started":1}
I20260811 12:40:36.243089 9237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.195452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:51479)
0811 12:40:36.214425 (+ 18973us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:36.214449 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:36.214703 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:36.215295 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:36.215300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:36.216111 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:36.216431 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.216445 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.218106 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.218111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.220145 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.220162 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.221753 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.221764 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.222100 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.223228 (+ 1128us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:36.223255 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:36.227784 (+ 4529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:36.234303 (+ 6519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.234314 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.234335 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.235186 (+ 851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.235890 (+ 704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.235895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.235899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.236283 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.237490 (+ 1207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:36.237502 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:36.238207 (+ 705us) client_negotiation.cc:769] Sending connection context
0811 12:40:36.240020 (+ 1813us) client_negotiation.cc:240] Negotiation successful
0811 12:40:36.240794 (+ 774us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18769,"mutex_wait_us":4,"spinlock_wait_cycles":6912,"thread_start_us":23771,"threads_started":1}
I20260811 12:40:36.244179 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.201681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:51871 (local address 127.0.186.125:34691)
0811 12:40:36.213615 (+ 11934us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.213623 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.219875 (+ 6252us) server_negotiation.cc:407] Connection header received
0811 12:40:36.219969 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.219974 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.220085 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.220208 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.222127 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.223475 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.225824 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.226367 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.226546 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.232536 (+ 5990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.232544 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.232550 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.232706 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.237527 (+ 4821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.238701 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.238707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.238710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.238917 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.239473 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.239479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.239482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.240398 (+ 916us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.240607 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.243026 (+ 2419us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.243293 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11800,"thread_start_us":11698,"threads_started":1}
I20260811 12:40:36.244436 9228 heartbeater.cc:347] Connected to a master server at 127.0.186.124:40917
I20260811 12:40:36.244570 9238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.201636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54450 (local address 127.0.186.67:45863)
0811 12:40:36.214987 (+ 13351us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.215001 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.215044 (+ 43us) server_negotiation.cc:407] Connection header received
0811 12:40:36.215135 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.215147 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.215469 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.219015 (+ 3546us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.219324 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.221366 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.223454 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.224544 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.225477 (+ 933us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.233833 (+ 8356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.233853 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.233876 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.233926 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.239516 (+ 5590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.240655 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.240666 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.240671 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.240937 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.241523 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.241527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.241531 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.241974 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.242357 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.243771 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.244107 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13133,"thread_start_us":12951,"threads_started":1}
I20260811 12:40:36.244897 9228 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:36.245285 9227 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39593
I20260811 12:40:36.244875 9232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.201144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.186.66:51871)
0811 12:40:36.219551 (+ 18407us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:36.219571 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:36.219737 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:36.220478 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:36.220483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:36.221233 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:36.221934 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.221948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.223639 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.223644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.225636 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.225657 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.226938 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.226947 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.227254 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.228526 (+ 1272us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:36.228551 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:36.232249 (+ 3698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:36.237708 (+ 5459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.237714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.237718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.238567 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.239072 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.239078 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.239081 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.239343 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.240670 (+ 1327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:36.240675 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:36.240879 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 12:40:36.241051 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 12:40:36.241319 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18258,"spinlock_wait_cycles":5248,"thread_start_us":12827,"threads_started":1}
I20260811 12:40:36.245450 9227 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:36.246274 8452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:36.246287 9227 heartbeater.cc:511] Master 127.0.186.126:39593 requested a full tablet report, sending...
I20260811 12:40:36.246348 9228 heartbeater.cc:511] Master 127.0.186.124:40917 requested a full tablet report, sending...
I20260811 12:40:36.246876 9229 heartbeater.cc:347] Connected to a master server at 127.0.186.125:34691
I20260811 12:40:36.247193 9229 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:36.248039 9229 heartbeater.cc:511] Master 127.0.186.125:34691 requested a full tablet report, sending...
I20260811 12:40:36.248646 8849 ts_manager.cc:194] Registered new tserver with Master: fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959)
I20260811 12:40:36.249794 8628 ts_manager.cc:194] Registered new tserver with Master: fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959)
I20260811 12:40:36.250977 7926 ts_manager.cc:194] Re-registered known tserver with Master: fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959)
I20260811 12:40:36.252746 7926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:51479
I20260811 12:40:36.339910 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 8313
I20260811 12:40:36.363530 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:45863
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:39593
--webserver_port=41547
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:36.591899 9059 heartbeater.cc:503] Master 127.0.186.126:39593 was elected leader, sending a full tablet report...
W20260811 12:40:36.743474 9242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:36.743810 9242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:36.744001 9242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:36.755281 9242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:36.755478 9242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:36.755635 9242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:36.766150 9242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:45863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=41547
--tserver_master_addrs=127.0.186.126:39593,127.0.186.125:34691,127.0.186.124:40917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:36.767520 9242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:36.768944 9242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:36.783962 9249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:36.783842 9250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:36.783870 9252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:36.784879 9242 server_base.cc:1034] running on GCE node
I20260811 12:40:36.785604 9242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:36.786700 9242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:36.787942 9242 hybrid_clock.cc:648] HybridClock initialized: now 1786452036787857 us; error 80 us; skew 500 ppm
I20260811 12:40:36.788305 9242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:36.799322 9242 init.cc:377] Logged in from keytab as oryx/127.0.186.67@KRBTEST.COM (short username oryx)
I20260811 12:40:36.801158 9242 webserver.cc:460] Webserver started at http://127.0.186.67:41547/ using document root <none> and password file <none>
I20260811 12:40:36.801883 9242 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:36.802044 9242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:36.809654 9242 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.006s
I20260811 12:40:36.812666 9260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:36.814234 9242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:40:36.814455 9242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "e29264604b4f422292ae945ac3f91c0e"
format_stamp: "Formatted at 2026-08-11 12:40:33 on dist-test-slave-qg60"
server_key: "887e54295200c3fcba2e0f347337903f"
server_key_iv: "bd7149f1cc4b08ddd89cf691c4e82912"
server_key_version: "encryptionkey@0"
I20260811 12:40:36.815585 9242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:36.851274 9242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:36.856959 9242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:36.857306 9242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:36.858517 9242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:36.860239 9242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:36.860386 9242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:36.860540 9242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:36.860643 9242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:36.900483 9242 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:45863
I20260811 12:40:36.900584 9393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:45863 every 8 connection(s)
I20260811 12:40:36.902069 9242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:36.904589 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 9242
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.125@KRBTEST.COM
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.124@KRBTEST.COM
I20260811 12:40:36.940447 9403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.906720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:59263 (local address 127.0.186.124:40917)
0811 12:40:36.912513 (+ 5793us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.912517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.917516 (+ 4999us) server_negotiation.cc:407] Connection header received
0811 12:40:36.917594 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.917599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.917702 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.917811 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.919611 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.921109 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.924201 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.925117 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.925242 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.930623 (+ 5381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.930633 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.930641 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.930699 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.936544 (+ 5845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.937555 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.937560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.937564 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.937779 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.938254 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.938259 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.938262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.938664 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.938807 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.939621 (+ 814us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.939860 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5671,"thread_start_us":5563,"threads_started":1}
I20260811 12:40:36.941774 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.905639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:33693 (local address 127.0.186.125:34691)
0811 12:40:36.906275 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.906284 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.908288 (+ 2004us) server_negotiation.cc:407] Connection header received
0811 12:40:36.912099 (+ 3811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.912110 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.912248 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.912356 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.915504 (+ 3148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.916962 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.920670 (+ 3708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.921649 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.921789 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.930029 (+ 8240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.930040 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.930048 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.930122 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.935457 (+ 5335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.936573 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.936579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.936585 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.936896 (+ 311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.937559 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.937564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.937567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.937965 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.938105 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.940985 (+ 2880us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.941271 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":360,"threads_started":1}
I20260811 12:40:36.942626 9401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.906382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.186.67:33693)
0811 12:40:36.908068 (+ 1686us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:36.908130 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:36.911634 (+ 3504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:36.913089 (+ 1455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:36.913103 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:36.914102 (+ 999us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:36.915206 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.915239 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.917261 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.917269 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.920424 (+ 3155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.920447 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.922316 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.922327 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.922882 (+ 555us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.923965 (+ 1083us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:36.924008 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:36.929597 (+ 5589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:36.935668 (+ 6071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.935678 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.935700 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.936388 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.937046 (+ 658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.937051 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.937054 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.937397 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.938198 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:36.938209 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:36.938810 (+ 601us) client_negotiation.cc:769] Sending connection context
0811 12:40:36.939200 (+ 390us) client_negotiation.cc:240] Negotiation successful
0811 12:40:36.939868 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1295,"mutex_wait_us":142,"thread_start_us":997,"threads_started":1}
I20260811 12:40:36.943368 9404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.906688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.186.67:59263)
0811 12:40:36.917213 (+ 10525us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:36.917234 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:36.917369 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:36.918062 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:36.918071 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:36.918970 (+ 899us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:36.919374 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.919390 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.921347 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.921356 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.923964 (+ 2608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.923988 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.925614 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.925624 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.925890 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.926690 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:36.926722 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:36.930287 (+ 3565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:36.936779 (+ 6492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.936786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.936793 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.937404 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.937934 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.937940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.937943 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.938113 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.938884 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:36.938889 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:36.939124 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 12:40:36.939303 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 12:40:36.941078 (+ 1775us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10383,"mutex_wait_us":1339,"thread_start_us":10302,"threads_started":1}
I20260811 12:40:36.944669 9396 heartbeater.cc:347] Connected to a master server at 127.0.186.124:40917
I20260811 12:40:36.945175 9396 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:36.946188 9396 heartbeater.cc:511] Master 127.0.186.124:40917 requested a full tablet report, sending...
I20260811 12:40:36.947388 9397 heartbeater.cc:347] Connected to a master server at 127.0.186.125:34691
I20260811 12:40:36.947589 9397 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:36.948335 9397 heartbeater.cc:511] Master 127.0.186.125:34691 requested a full tablet report, sending...
I20260811 12:40:36.949959 8628 ts_manager.cc:194] Registered new tserver with Master: e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863)
I20260811 12:40:36.949998 8849 ts_manager.cc:194] Registered new tserver with Master: e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863)
Aug 11 12:40:36 dist-test-slave-qg60 krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452036, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:36.967114 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.923714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:42767)
0811 12:40:36.932922 (+ 9208us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:36.932944 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:36.933072 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:36.933818 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:36.933827 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:36.934582 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:36.935082 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.935099 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.937837 (+ 2738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.937846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.940302 (+ 2456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:36.940323 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.941976 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.941985 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:36.942204 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.951992 (+ 9788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:36.952028 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:36.957382 (+ 5354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:36.963634 (+ 6252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.963641 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.963645 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.964275 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.964871 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:36.964875 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:36.964878 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:36.965139 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:36.965858 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:36.965863 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:36.966036 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 12:40:36.966207 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 12:40:36.966567 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8872,"mutex_wait_us":4,"thread_start_us":8664,"threads_started":1}
I20260811 12:40:36.968290 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.917698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:42767 (local address 127.0.186.126:39593)
0811 12:40:36.933043 (+ 15345us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.933050 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.933072 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:40:36.933237 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.933270 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.933455 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.933554 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.935323 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.937581 (+ 2258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.940550 (+ 2969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.941438 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.941548 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.957732 (+ 16184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.957740 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.957747 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.957798 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.963414 (+ 5616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.964422 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.964429 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.964433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.964699 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.965277 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.965283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.965287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.965709 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.965878 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.967476 (+ 1598us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.967820 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15187,"thread_start_us":15079,"threads_started":1}
I20260811 12:40:36.969587 9394 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39593
I20260811 12:40:36.969792 9394 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:36.970330 9394 heartbeater.cc:511] Master 127.0.186.126:39593 requested a full tablet report, sending...
I20260811 12:40:36.971668 7926 ts_manager.cc:194] Re-registered known tserver with Master: e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863)
I20260811 12:40:36.973559 7926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:42767
I20260811 12:40:36.975775 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.943993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.0.186.125:34691)
0811 12:40:36.950764 (+ 6771us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.950768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.950785 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:40:36.950829 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.950832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.950891 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.951018 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.956865 (+ 5847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.958096 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.961209 (+ 3113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.962094 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.962256 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.966592 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.966597 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.966601 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.966636 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.970607 (+ 3971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.972435 (+ 1828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.972445 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.972449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.972622 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.973420 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.973427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.973431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.974014 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.974328 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.975021 (+ 693us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.975303 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6596}
I20260811 12:40:36.978473 9412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.943539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.0.186.126:39593)
0811 12:40:36.952186 (+ 8647us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.952195 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.952227 (+ 32us) server_negotiation.cc:407] Connection header received
0811 12:40:36.952310 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.952328 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.952413 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.952568 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.955591 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.957115 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.959837 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.960842 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.961900 (+ 1058us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.968348 (+ 6448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.968357 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.968365 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.968411 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.974629 (+ 6218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.975644 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.975650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.975654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.975820 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.976333 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.976339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.976344 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.976731 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.977025 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.977882 (+ 857us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.978088 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8458,"thread_start_us":10870,"threads_started":1}
I20260811 12:40:36.980710 9403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:36.945807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37670 (local address 127.0.186.124:40917)
0811 12:40:36.946037 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:36.946042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:36.955808 (+ 9766us) server_negotiation.cc:407] Connection header received
0811 12:40:36.956246 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:36.956253 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:36.956389 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:36.956481 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:36.961989 (+ 5508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.963394 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.966231 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:36.966942 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:36.967151 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:36.971759 (+ 4608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:36.971766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:36.971771 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:36.971817 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:36.976019 (+ 4202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.978345 (+ 2326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.978352 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.978355 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.978568 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:36.979110 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:36.979114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:36.979116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:36.979396 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:36.979612 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:36.980078 (+ 466us) server_negotiation.cc:299] Negotiation successful
0811 12:40:36.980254 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:40:36.983489 7926 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:36.992321 7926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:37.038744 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.020849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.0.186.67:45863)
0811 12:40:37.021935 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.021948 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.025515 (+ 3567us) server_negotiation.cc:407] Connection header received
0811 12:40:37.025904 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.025916 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.026295 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.026541 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.027916 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.030219 (+ 2303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.034297 (+ 4078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.036623 (+ 2326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.036790 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.037091 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.037907 (+ 816us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.038186 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":628,"threads_started":1}
I20260811 12:40:37.040187 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.019813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45863 (local address 127.0.0.1:54456)
0811 12:40:37.025342 (+ 5529us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.025404 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.025654 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.027145 (+ 1491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.027153 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.027194 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.027642 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.027658 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.030785 (+ 3127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.030794 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.034050 (+ 3256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.034074 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.037354 (+ 3280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.037363 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.037635 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.037689 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.039380 (+ 1691us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.039600 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5313,"thread_start_us":689,"threads_started":1}
I20260811 12:40:37.046433 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.018926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42959 (local address 127.0.0.1:36118)
0811 12:40:37.021071 (+ 2145us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.021099 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.021403 (+ 304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.036933 (+ 15530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.036939 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.036974 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.037426 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.037440 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.039814 (+ 2374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.039819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.042840 (+ 3021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.042860 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.045352 (+ 2492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.045360 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.045600 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.045658 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.045746 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.045987 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1776,"thread_start_us":6052,"threads_started":1}
I20260811 12:40:37.047639 9427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.019231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36118 (local address 127.0.186.66:42959)
0811 12:40:37.035837 (+ 16606us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.035847 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.035886 (+ 39us) server_negotiation.cc:407] Connection header received
0811 12:40:37.036046 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.036059 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.036401 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.037719 (+ 1318us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.038033 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.039619 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.043105 (+ 3486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.045053 (+ 1948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.046710 (+ 1657us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.046976 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.047053 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.047244 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16395,"thread_start_us":17364,"threads_started":1}
I20260811 12:40:37.047292 9316 tablet_service.cc:1467] Processing CreateTablet for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb (DEFAULT_TABLE table=test-table [id=1ab22192965341e98b7a65d9a533a4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:37.049924 9316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:37.052146 9152 tablet_service.cc:1467] Processing CreateTablet for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb (DEFAULT_TABLE table=test-table [id=1ab22192965341e98b7a65d9a533a4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:37.055317 9152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:37.056593 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.029530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:37865 (local address 127.0.0.1:57764)
0811 12:40:37.046298 (+ 16768us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.046320 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.046481 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.047616 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.047622 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.047655 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.048266 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.048281 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.050514 (+ 2233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.050519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.053068 (+ 2549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.053086 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.055703 (+ 2617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.055710 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.055925 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.055963 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.056081 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.056251 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16636,"thread_start_us":17050,"threads_started":1}
I20260811 12:40:37.057477 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.025816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.0.186.65:37865)
0811 12:40:37.046312 (+ 20496us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.046323 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.046876 (+ 553us) server_negotiation.cc:407] Connection header received
0811 12:40:37.047021 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.047030 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.047339 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.047600 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.048573 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.050334 (+ 1761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.053355 (+ 3021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.055147 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.055302 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.055537 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.056908 (+ 1371us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.057128 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20280,"thread_start_us":20996,"threads_started":1}
I20260811 12:40:37.061934 8981 tablet_service.cc:1467] Processing CreateTablet for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb (DEFAULT_TABLE table=test-table [id=1ab22192965341e98b7a65d9a533a4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:37.063843 8981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:37.069540 9433 tablet_bootstrap.cc:492] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Bootstrap starting.
I20260811 12:40:37.075374 9433 tablet_bootstrap.cc:654] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:37.077513 9433 log.cc:824] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:37.079770 9434 tablet_bootstrap.cc:492] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Bootstrap starting.
I20260811 12:40:37.082052 9433 tablet_bootstrap.cc:492] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: No bootstrap required, opened a new log
I20260811 12:40:37.082439 9433 ts_tablet_manager.cc:1397] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260811 12:40:37.083853 9434 tablet_bootstrap.cc:654] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:37.085435 9434 log.cc:824] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:37.087098 9438 tablet_bootstrap.cc:492] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Bootstrap starting.
I20260811 12:40:37.089289 9434 tablet_bootstrap.cc:492] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: No bootstrap required, opened a new log
I20260811 12:40:37.089706 9434 ts_tablet_manager.cc:1397] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 12:40:37.091728 9438 tablet_bootstrap.cc:654] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:37.093276 9438 log.cc:824] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:37.095337 9433 raft_consensus.cc:348] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.095728 9433 raft_consensus.cc:374] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:37.095899 9433 raft_consensus.cc:729] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29264604b4f422292ae945ac3f91c0e, State: Initialized, Role: FOLLOWER
I20260811 12:40:37.096550 9433 consensus_queue.cc:260] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.097236 9438 tablet_bootstrap.cc:492] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: No bootstrap required, opened a new log
I20260811 12:40:37.097584 9438 ts_tablet_manager.cc:1397] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260811 12:40:37.097959 9394 heartbeater.cc:503] Master 127.0.186.126:39593 was elected leader, sending a full tablet report...
I20260811 12:40:37.098609 9433 ts_tablet_manager.cc:1428] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Time spent starting tablet: real 0.016s user 0.012s sys 0.003s
I20260811 12:40:37.107100 9434 raft_consensus.cc:348] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.107798 9434 raft_consensus.cc:374] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:37.107935 9434 raft_consensus.cc:729] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5e8cfc5bc54f3a801eecf84e758b87, State: Initialized, Role: FOLLOWER
I20260811 12:40:37.108692 9434 consensus_queue.cc:260] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.109771 9438 raft_consensus.cc:348] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.110224 9227 heartbeater.cc:503] Master 127.0.186.126:39593 was elected leader, sending a full tablet report...
I20260811 12:40:37.110347 9438 raft_consensus.cc:374] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:37.110461 9438 raft_consensus.cc:729] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bb570a462642a689a72ca6ae0711f6, State: Initialized, Role: FOLLOWER
I20260811 12:40:37.111027 9434 ts_tablet_manager.cc:1428] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Time spent starting tablet: real 0.021s user 0.012s sys 0.003s
I20260811 12:40:37.111218 9438 consensus_queue.cc:260] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.113819 9438 ts_tablet_manager.cc:1428] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
W20260811 12:40:37.155582 9398 tablet.cc:2369] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:40:37.207259 9235 tablet.cc:2369] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:40:37.282722 9063 tablet.cc:2369] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:37.295766 9441 raft_consensus.cc:482] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:37.296161 9441 raft_consensus.cc:504] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.298094 9441 leader_election.cc:288] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959), a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865)
I20260811 12:40:37.305817 9443 raft_consensus.cc:482] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:37.306406 9404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.298827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:37865 (local address 127.0.186.67:41619)
0811 12:40:37.299078 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.299092 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.299200 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.299617 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.299620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.299642 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.299811 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.299818 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.301297 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.301302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.303385 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.303396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.305392 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.305398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.305653 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.305696 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.305834 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.305995 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":51}
I20260811 12:40:37.306566 9427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.298524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:39271 (local address 127.0.186.66:42959)
0811 12:40:37.298744 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.298753 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.298783 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:40:37.298946 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.298952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.299042 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.299158 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.299584 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.300839 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.303541 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.305190 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.305385 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.305461 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.306145 (+ 684us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.306278 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:40:37.306313 9443 raft_consensus.cc:504] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.306883 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.298339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42959 (local address 127.0.186.67:39271)
0811 12:40:37.298591 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.298630 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.298782 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.299188 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.299192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.299214 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.299426 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.299435 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.301007 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.301011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.303248 (+ 2237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.303265 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.305392 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.305399 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.305866 (+ 467us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.305903 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.306108 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.306242 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":98}
I20260811 12:40:37.306996 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.299046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:41619 (local address 127.0.186.65:37865)
0811 12:40:37.299315 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.299321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.299345 (+ 24us) server_negotiation.cc:407] Connection header received
0811 12:40:37.299403 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.299406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.299473 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.299600 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.299957 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.301159 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.303608 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.305220 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.305382 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.305461 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.306508 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.306662 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 12:40:37.307999 9003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63c34ec1e52c4d3ab42c7709f4fe66eb" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bb570a462642a689a72ca6ae0711f6" is_pre_election: true
I20260811 12:40:37.308007 9175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63c34ec1e52c4d3ab42c7709f4fe66eb" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" is_pre_election: true
I20260811 12:40:37.308624 9003 raft_consensus.cc:2454] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 0.
I20260811 12:40:37.308702 9175 raft_consensus.cc:2454] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 0.
I20260811 12:40:37.309677 9264 leader_election.cc:302] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e29264604b4f422292ae945ac3f91c0e, fb5e8cfc5bc54f3a801eecf84e758b87; no voters:
I20260811 12:40:37.310668 9441 raft_consensus.cc:2781] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:37.310928 9441 raft_consensus.cc:482] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:37.311055 9441 raft_consensus.cc:3037] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:37.311712 9443 leader_election.cc:288] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959), e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863)
I20260811 12:40:37.315107 9441 raft_consensus.cc:504] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.315750 9441 leader_election.cc:288] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 election: Requested vote from peers fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959), a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865)
I20260811 12:40:37.316306 9175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63c34ec1e52c4d3ab42c7709f4fe66eb" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87"
I20260811 12:40:37.316632 9175 raft_consensus.cc:3037] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:37.316779 9003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63c34ec1e52c4d3ab42c7709f4fe66eb" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bb570a462642a689a72ca6ae0711f6"
I20260811 12:40:37.317050 9003 raft_consensus.cc:3037] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:37.320242 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.310238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:59531 (local address 127.0.186.67:45863)
0811 12:40:37.310436 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.310442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.311974 (+ 1532us) server_negotiation.cc:407] Connection header received
0811 12:40:37.312167 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.312173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.312247 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.312352 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.313251 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.314274 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.317384 (+ 3110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.318697 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.318845 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.318937 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.319844 (+ 907us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.319992 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 12:40:37.320889 9003 raft_consensus.cc:2454] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 1.
I20260811 12:40:37.320886 9175 raft_consensus.cc:2454] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 1.
I20260811 12:40:37.321153 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.309729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45863 (local address 127.0.186.65:59531)
0811 12:40:37.311839 (+ 2110us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.311868 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.312026 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.312369 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.312374 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.312405 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.313019 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.313038 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.314414 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.314428 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.317175 (+ 2747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.317201 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.319267 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.319274 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.319522 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.319677 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.320469 (+ 792us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.320638 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1926,"mutex_wait_us":1,"thread_start_us":1681,"threads_started":1}
I20260811 12:40:37.321348 9427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.310112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:57849 (local address 127.0.186.66:42959)
0811 12:40:37.310276 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.310281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.311630 (+ 1349us) server_negotiation.cc:407] Connection header received
0811 12:40:37.312392 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.312400 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.312490 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.312555 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:37.313404 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.314654 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.317580 (+ 2926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.319688 (+ 2108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.319836 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.319903 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.320610 (+ 707us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.320770 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:40:37.321741 9444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.309542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42959 (local address 127.0.186.65:57849)
0811 12:40:37.311523 (+ 1981us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:37.311545 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:37.311755 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:37.312717 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:37.312720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:37.312793 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:37.313253 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.313265 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.314819 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.314827 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.317342 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:37.317358 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.320122 (+ 2764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.320128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:37.320405 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.320457 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 12:40:37.320917 (+ 460us) client_negotiation.cc:240] Negotiation successful
0811 12:40:37.321057 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1810,"thread_start_us":1387,"threads_started":1}
I20260811 12:40:37.322273 9340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63c34ec1e52c4d3ab42c7709f4fe66eb" candidate_uuid: "a6bb570a462642a689a72ca6ae0711f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29264604b4f422292ae945ac3f91c0e" is_pre_election: true
I20260811 12:40:37.322808 9340 raft_consensus.cc:2379] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6bb570a462642a689a72ca6ae0711f6 in current term 1: Already voted for candidate e29264604b4f422292ae945ac3f91c0e in this term.
I20260811 12:40:37.323655 9264 leader_election.cc:302] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bb570a462642a689a72ca6ae0711f6, e29264604b4f422292ae945ac3f91c0e; no voters:
I20260811 12:40:37.323974 9175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63c34ec1e52c4d3ab42c7709f4fe66eb" candidate_uuid: "a6bb570a462642a689a72ca6ae0711f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" is_pre_election: true
I20260811 12:40:37.324105 9441 raft_consensus.cc:2781] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:37.324344 9175 raft_consensus.cc:2379] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6bb570a462642a689a72ca6ae0711f6 in current term 1: Already voted for candidate e29264604b4f422292ae945ac3f91c0e in this term.
I20260811 12:40:37.324707 9441 raft_consensus.cc:686] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 1 LEADER]: Becoming Leader. State: Replica: e29264604b4f422292ae945ac3f91c0e, State: Running, Role: LEADER
I20260811 12:40:37.325202 8933 leader_election.cc:302] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6bb570a462642a689a72ca6ae0711f6; no voters: e29264604b4f422292ae945ac3f91c0e, fb5e8cfc5bc54f3a801eecf84e758b87
I20260811 12:40:37.325423 9441 consensus_queue.cc:237] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } }
I20260811 12:40:37.325718 9443 raft_consensus.cc:2726] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 12:40:37.331360 7925 catalog_manager.cc:5495] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e reported cstate change: term changed from 0 to 1, leader changed from <none> to e29264604b4f422292ae945ac3f91c0e (127.0.186.67). New cstate: current_term: 1 leader_uuid: "e29264604b4f422292ae945ac3f91c0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } health_report { overall_health: HEALTHY } } }
I20260811 12:40:37.409062 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.402129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54460 (local address 127.0.186.67:45863)
0811 12:40:37.402359 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.402366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.402564 (+ 198us) server_negotiation.cc:407] Connection header received
0811 12:40:37.402746 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.402750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.402880 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.403016 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:37.403539 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.404576 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.406258 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.406886 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.407036 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.407579 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:37.408205 (+ 626us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:37.408378 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.408530 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.408628 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 12:40:37.419085 9175 raft_consensus.cc:1261] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Refusing update from remote peer e29264604b4f422292ae945ac3f91c0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:37.419317 9003 raft_consensus.cc:1261] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Refusing update from remote peer e29264604b4f422292ae945ac3f91c0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:37.420359 9446 consensus_queue.cc:1035] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:37.420979 9441 consensus_queue.cc:1035] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:37.442785 9449 mvcc.cc:205] Tried to move back new op lower bound from 7317307545257369600 to 7317307544889856000. Current Snapshot: MvccSnapshot[applied={T|T < 7317307545257369600}]
I20260811 12:40:37.461676 7925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:37.462121 7925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:37.470031 7925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d3c21f28c6d4a458d25e4e8574ffa04: Sending DeleteTablet for 3 replicas of tablet 63c34ec1e52c4d3ab42c7709f4fe66eb
I20260811 12:40:37.471462 9152 tablet_service.cc:1514] Processing DeleteTablet for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:37 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:36118
I20260811 12:40:37.472564 9316 tablet_service.cc:1514] Processing DeleteTablet for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:37 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:54456
I20260811 12:40:37.472669 8981 tablet_service.cc:1514] Processing DeleteTablet for tablet 63c34ec1e52c4d3ab42c7709f4fe66eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:37 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57764
I20260811 12:40:37.489616 9461 tablet_replica.cc:330] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: stopping tablet replica
I20260811 12:40:37.490407 9461 raft_consensus.cc:2229] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:37.491268 9461 raft_consensus.cc:2258] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:37.494336 9461 ts_tablet_manager.cc:1905] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:37.501637 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 7887
I20260811 12:40:37.503249 7960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:37.507043 9463 tablet_replica.cc:330] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: stopping tablet replica
I20260811 12:40:37.507850 9463 raft_consensus.cc:2229] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:37.509341 9462 tablet_replica.cc:330] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: stopping tablet replica
I20260811 12:40:37.509961 9462 raft_consensus.cc:2229] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:37.510293 9463 raft_consensus.cc:2258] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:37.510748 9462 raft_consensus.cc:2258] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:37.514024 9462 ts_tablet_manager.cc:1905] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:37.519241 9461 ts_tablet_manager.cc:1918] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:37.519469 9461 log.cc:1196] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/63c34ec1e52c4d3ab42c7709f4fe66eb
I20260811 12:40:37.520262 9461 ts_tablet_manager.cc:1939] T 63c34ec1e52c4d3ab42c7709f4fe66eb P fb5e8cfc5bc54f3a801eecf84e758b87: Deleting consensus metadata
I20260811 12:40:37.520699 9463 ts_tablet_manager.cc:1905] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:37.531417 9463 ts_tablet_manager.cc:1918] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:37.531698 9463 log.cc:1196] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/63c34ec1e52c4d3ab42c7709f4fe66eb
I20260811 12:40:37.532384 9463 ts_tablet_manager.cc:1939] T 63c34ec1e52c4d3ab42c7709f4fe66eb P e29264604b4f422292ae945ac3f91c0e: Deleting consensus metadata
I20260811 12:40:37.534008 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.475537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36940 (local address 127.0.186.125:34691)
0811 12:40:37.475725 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.475731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.504666 (+ 28935us) server_negotiation.cc:407] Connection header received
0811 12:40:37.508972 (+ 4306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.508983 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.509072 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.509199 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:37.512644 (+ 3445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.514285 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.517242 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.517986 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.518120 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.523317 (+ 5197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:37.523328 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:37.523336 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:37.523404 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:37.529263 (+ 5859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.530631 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.530638 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.530642 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.530809 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.531339 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.531344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.531347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.532117 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:37.532441 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.533240 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.533501 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:40:37.535583 9462 ts_tablet_manager.cc:1918] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:37.535789 9462 log.cc:1196] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/63c34ec1e52c4d3ab42c7709f4fe66eb
I20260811 12:40:37.536510 9462 ts_tablet_manager.cc:1939] T 63c34ec1e52c4d3ab42c7709f4fe66eb P a6bb570a462642a689a72ca6ae0711f6: Deleting consensus metadata
I20260811 12:40:37.557106 9466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.493471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37672 (local address 127.0.186.124:40917)
0811 12:40:37.505631 (+ 12160us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.505642 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.535337 (+ 29695us) server_negotiation.cc:407] Connection header received
0811 12:40:37.535665 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.535671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.535821 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.535912 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:37.538581 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.540125 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.542503 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.543376 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.543490 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.547968 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:37.547975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:37.547980 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:37.548030 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:37.553011 (+ 4981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.554048 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.554066 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.554070 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.554256 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.554937 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.554944 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.554948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.555367 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:37.555663 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.556334 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.556605 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11960,"thread_start_us":12191,"threads_started":1}
I20260811 12:40:37.669559 7905 catalog_manager.cc:4841] TS e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863): tablet 63c34ec1e52c4d3ab42c7709f4fe66eb (table test-table [id=1ab22192965341e98b7a65d9a533a4ac]) successfully deleted
I20260811 12:40:37.669751 7909 catalog_manager.cc:4841] TS fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959): tablet 63c34ec1e52c4d3ab42c7709f4fe66eb (table test-table [id=1ab22192965341e98b7a65d9a533a4ac]) successfully deleted
W20260811 12:40:37.672408 7909 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.186.66:42959, user_credentials={real_user=slave}} blocked reactor thread for 149799us
I20260811 12:40:37.673074 7909 catalog_manager.cc:4841] TS a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865): tablet 63c34ec1e52c4d3ab42c7709f4fe66eb (table test-table [id=1ab22192965341e98b7a65d9a533a4ac]) successfully deleted
I20260811 12:40:37.673204 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 7887
I20260811 12:40:37.738911 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.716627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36952 (local address 127.0.186.125:34691)
0811 12:40:37.716954 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.716963 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.717962 (+ 999us) server_negotiation.cc:407] Connection header received
0811 12:40:37.718159 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.718166 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.718285 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.718425 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:37.720759 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.722389 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.724438 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.725587 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.725756 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.730009 (+ 4253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:37.730019 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:37.730028 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:37.730093 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:37.734451 (+ 4358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.735412 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.735420 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.735425 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.735629 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.736899 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.736912 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.736915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.737335 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:37.737605 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.738178 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.738510 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:40:37.747153 9466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:37.718089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37688 (local address 127.0.186.124:40917)
0811 12:40:37.718279 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:37.718285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:37.728342 (+ 10057us) server_negotiation.cc:407] Connection header received
0811 12:40:37.728573 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:37.728578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:37.728678 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:37.728881 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:37.732813 (+ 3932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.733944 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.735692 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:37.736163 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:37.736309 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:37.740168 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:37.740176 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:37.740182 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:37.740228 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:37.744182 (+ 3954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.745021 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.745028 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.745032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.745195 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:37.745570 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:37.745575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:37.745578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:37.745965 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:37.746215 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:37.746537 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 12:40:37.746793 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 12:40:38.445364 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.444379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:41093)
0811 12:40:38.445046 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.445177 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":352,"threads_started":1}
W20260811 12:40:38.445798 9059 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:39593 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:38.448630 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.447563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:39603)
0811 12:40:38.448140 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.448326 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":280,"threads_started":1}
W20260811 12:40:38.449213 9227 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:39593 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:38.449321 9479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.447845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:34495)
0811 12:40:38.448880 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.449059 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":911,"thread_start_us":753,"threads_started":1}
W20260811 12:40:38.449837 9394 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:39593 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:38.970710 9480 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d3c21f28c6d4a458d25e4e8574ffa04)
I20260811 12:40:38.971215 9481 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d3c21f28c6d4a458d25e4e8574ffa04)
I20260811 12:40:38.971176 9480 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } }
I20260811 12:40:38.971439 9481 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } }
I20260811 12:40:38.972491 9481 leader_election.cc:288] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593), fc25b7d657ec4a13a82006ffb09976ef (127.0.186.124:40917)
I20260811 12:40:38.972978 9480 leader_election.cc:288] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593), dc0a3ab91f0f49a3a239d2d36fe5dfbb (127.0.186.125:34691)
I20260811 12:40:38.974313 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.972872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49462)
0811 12:40:38.973716 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.973943 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":504,"threads_started":1}
I20260811 12:40:38.976493 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.973091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49468)
0811 12:40:38.975903 (+ 2812us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.976127 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2631,"thread_start_us":2447,"threads_started":1}
W20260811 12:40:38.984792 8835 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
W20260811 12:40:38.987615 8612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:38.988060 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.973153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:34691 (local address 127.0.0.1:36956)
0811 12:40:38.976895 (+ 3742us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.976919 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:38.977105 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:38.978268 (+ 1163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:38.978277 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:38.978319 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:38.978713 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:38.978729 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.981202 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.981211 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:38.984230 (+ 3019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:38.984254 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.987070 (+ 2816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.987080 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:38.987359 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:38.987398 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 12:40:38.987493 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 12:40:38.987658 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3614,"mutex_wait_us":4,"thread_start_us":13357,"threads_started":1}
I20260811 12:40:38.989341 9488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.976352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36956 (local address 127.0.186.125:34691)
0811 12:40:38.977790 (+ 1438us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:38.977800 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:38.977824 (+ 24us) server_negotiation.cc:407] Connection header received
0811 12:40:38.977907 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:38.977915 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:38.978062 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:38.978899 (+ 837us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:38.979153 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.980946 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.984546 (+ 3600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.986787 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.988321 (+ 1534us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:38.988462 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:38.988530 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 12:40:38.988761 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1266,"thread_start_us":1012,"threads_started":1}
I20260811 12:40:38.990110 8638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc25b7d657ec4a13a82006ffb09976ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" is_pre_election: true
I20260811 12:40:38.990547 8638 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc25b7d657ec4a13a82006ffb09976ef in term 1.
I20260811 12:40:38.991209 8836 leader_election.cc:302] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc0a3ab91f0f49a3a239d2d36fe5dfbb, fc25b7d657ec4a13a82006ffb09976ef; no voters:
I20260811 12:40:38.991559 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.991123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49498)
0811 12:40:38.991273 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.991377 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 12:40:38.991634 9480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 12:40:38.991590 9486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.990780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49484)
0811 12:40:38.991054 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.991243 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260811 12:40:38.991782 9480 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d3c21f28c6d4a458d25e4e8574ffa04)
W20260811 12:40:38.991886 8835 leader_election.cc:334] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593): Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:38.992089 9480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 1 FOLLOWER]: Advancing to term 2
W20260811 12:40:38.992019 8612 leader_election.cc:334] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593): Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:38.994997 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.973808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:40917 (local address 127.0.0.1:37698)
0811 12:40:38.975007 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.975032 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:38.975221 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:38.985853 (+ 10632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:38.985860 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:38.985899 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:38.986353 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:38.986372 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.989610 (+ 3238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.989615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:38.991988 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:38.992017 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.994070 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.994077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:38.994281 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:38.994335 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 12:40:38.994455 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 12:40:38.994612 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1056,"thread_start_us":13431,"threads_started":1}
I20260811 12:40:38.995700 9480 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } }
I20260811 12:40:38.996047 9487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.975857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.0.186.124:40917)
0811 12:40:38.985070 (+ 9213us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:38.985076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:38.985099 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:40:38.985164 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:38.985169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:38.985242 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:38.986807 (+ 1565us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:38.987605 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.989429 (+ 1824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.992279 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:38.993762 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:38.993916 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:38.994045 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:38.995216 (+ 1171us) server_negotiation.cc:299] Negotiation successful
0811 12:40:38.995369 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":373,"server-negotiator.queue_time_us":9070,"thread_start_us":8533,"threads_started":1}
I20260811 12:40:38.996577 9480 leader_election.cc:288] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [CANDIDATE]: Term 2 election: Requested vote from peers 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593), dc0a3ab91f0f49a3a239d2d36fe5dfbb (127.0.186.125:34691)
I20260811 12:40:38.996649 8861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fc25b7d657ec4a13a82006ffb09976ef" is_pre_election: true
I20260811 12:40:38.997062 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.996638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49520)
0811 12:40:38.996808 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.996901 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 12:40:38.997092 8861 raft_consensus.cc:2379] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc0a3ab91f0f49a3a239d2d36fe5dfbb in current term 2: Already voted for candidate fc25b7d657ec4a13a82006ffb09976ef in this term.
I20260811 12:40:38.997117 8638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc25b7d657ec4a13a82006ffb09976ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb"
I20260811 12:40:38.997349 8638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 1 FOLLOWER]: Advancing to term 2
I20260811 12:40:38.997789 8612 leader_election.cc:302] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc0a3ab91f0f49a3a239d2d36fe5dfbb; no voters: 4d3c21f28c6d4a458d25e4e8574ffa04, fc25b7d657ec4a13a82006ffb09976ef
I20260811 12:40:38.998276 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:38.997882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49530)
0811 12:40:38.998038 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:38.998118 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 12:40:38.998550 8835 leader_election.cc:334] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593): Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
I20260811 12:40:39.000689 8638 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc25b7d657ec4a13a82006ffb09976ef in term 2.
I20260811 12:40:39.001081 9481 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:40:39.001523 8836 leader_election.cc:302] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dc0a3ab91f0f49a3a239d2d36fe5dfbb, fc25b7d657ec4a13a82006ffb09976ef; no voters: 4d3c21f28c6d4a458d25e4e8574ffa04
I20260811 12:40:39.001930 9480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 2 FOLLOWER]: Leader election won for term 2
I20260811 12:40:39.002602 9480 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [term 2 LEADER]: Becoming Leader. State: Replica: fc25b7d657ec4a13a82006ffb09976ef, State: Running, Role: LEADER
I20260811 12:40:39.003041 9480 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } }
I20260811 12:40:39.005681 9491 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc25b7d657ec4a13a82006ffb09976ef. Latest consensus state: current_term: 2 leader_uuid: "fc25b7d657ec4a13a82006ffb09976ef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:39.006057 9491 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:39.006816 9493 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:39.010895 9493 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:39.011766 9493 catalog_manager.cc:1259] Loaded cluster ID: 6e96288315a7474db5368c83256280c6
I20260811 12:40:39.011873 9493 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:39.013298 9493 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:39.014175 9493 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Loaded TSK: 0
I20260811 12:40:39.015034 9493 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:40:39.052193 8848 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37688:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:39.059736 8848 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:39.064618 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.064090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49546)
0811 12:40:39.064306 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.064439 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 12:40:39.064798 8638 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [term 2 FOLLOWER]: Refusing update from remote peer fc25b7d657ec4a13a82006ffb09976ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 12:40:39.065996 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.065440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49556)
0811 12:40:39.065601 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.065751 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 12:40:39.065794 9491 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 12:40:39.066260 8835 consensus_peers.cc:487] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef -> Peer 4d3c21f28c6d4a458d25e4e8574ffa04 (127.0.186.126:39593): Couldn't send request to peer 4d3c21f28c6d4a458d25e4e8574ffa04. Status: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 12:40:39.069370 9481 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc25b7d657ec4a13a82006ffb09976ef. Latest consensus state: current_term: 2 leader_uuid: "fc25b7d657ec4a13a82006ffb09976ef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:39.069730 9481 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:40:39.071529 9491 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "fc25b7d657ec4a13a82006ffb09976ef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:39.072063 9491 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:39.073046 9481 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "fc25b7d657ec4a13a82006ffb09976ef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "4d3c21f28c6d4a458d25e4e8574ffa04" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39593 } } peers { permanent_uuid: "dc0a3ab91f0f49a3a239d2d36fe5dfbb" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 34691 } attrs { promote: false } } peers { permanent_uuid: "fc25b7d657ec4a13a82006ffb09976ef" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 40917 } attrs { promote: false } } }
I20260811 12:40:39.073345 9481 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0a3ab91f0f49a3a239d2d36fe5dfbb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:40:39.095727 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.082497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54476 (local address 127.0.186.67:45863)
0811 12:40:39.084064 (+ 1567us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.084074 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.084105 (+ 31us) server_negotiation.cc:407] Connection header received
0811 12:40:39.084210 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.084219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.085841 (+ 1622us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.086003 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:39.086748 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.088395 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.092435 (+ 4040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.094442 (+ 2007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.094680 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.094809 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.095177 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.095340 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1380,"thread_start_us":309,"threads_started":1}
I20260811 12:40:39.095727 9485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.081894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45863 (local address 127.0.0.1:54476)
0811 12:40:39.082214 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.082235 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:39.082341 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:39.086011 (+ 3670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:39.086018 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:39.086051 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:39.086536 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:39.086551 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.088645 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.088655 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:39.092053 (+ 3398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:39.092082 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.094756 (+ 2674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.094763 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:39.094979 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.095008 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 12:40:39.095134 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 12:40:39.095306 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260811 12:40:39.097015 9316 tablet_service.cc:1467] Processing CreateTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 (DEFAULT_TABLE table=test-table [id=da4ded6a771b4fcb9124f6eeb519beca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:39.097587 9316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:39.101747 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.083439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.0.186.66:42959)
0811 12:40:39.094788 (+ 11349us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.094798 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.094828 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:40:39.094924 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.094932 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.095052 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.096121 (+ 1069us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:39.096373 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.097523 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.099855 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.100612 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.100782 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.100908 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.101281 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.101424 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11148,"thread_start_us":10988,"threads_started":1}
I20260811 12:40:39.101784 9503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.083155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42959 (local address 127.0.0.1:36122)
0811 12:40:39.085596 (+ 2441us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.085621 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:39.085778 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:39.095270 (+ 9492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:39.095278 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:39.095320 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:39.095870 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:39.095885 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.097725 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.097730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:39.099660 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:39.099672 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.100886 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.100893 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:39.101100 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.101126 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 12:40:39.101254 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 12:40:39.101402 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":481,"threads_started":1}
I20260811 12:40:39.102862 9152 tablet_service.cc:1467] Processing CreateTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 (DEFAULT_TABLE table=test-table [id=da4ded6a771b4fcb9124f6eeb519beca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:39.103336 9152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:39.104027 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.081541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:37865 (local address 127.0.0.1:57780)
0811 12:40:39.081907 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.081930 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:39.082063 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:39.097395 (+ 15332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:39.097403 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:39.097437 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:39.097673 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:39.097686 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.099233 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.099239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:39.101349 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:39.101365 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.103150 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.103158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:39.103365 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.103406 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 12:40:39.103476 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 12:40:39.103630 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238}
I20260811 12:40:39.105121 9501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.081680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57780 (local address 127.0.186.65:37865)
0811 12:40:39.097054 (+ 15374us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.097061 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.097082 (+ 21us) server_negotiation.cc:407] Connection header received
0811 12:40:39.097163 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.097169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.097246 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.097357 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:39.097892 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.099032 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.101593 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.102941 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.104400 (+ 1459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.104519 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.104574 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.104721 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15236,"thread_start_us":15775,"threads_started":1}
I20260811 12:40:39.106232 8981 tablet_service.cc:1467] Processing CreateTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 (DEFAULT_TABLE table=test-table [id=da4ded6a771b4fcb9124f6eeb519beca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:39.106745 8981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:39.110939 9507 tablet_bootstrap.cc:492] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Bootstrap starting.
I20260811 12:40:39.112061 9505 tablet_bootstrap.cc:492] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Bootstrap starting.
I20260811 12:40:39.113411 9508 tablet_bootstrap.cc:492] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Bootstrap starting.
I20260811 12:40:39.113515 9507 tablet_bootstrap.cc:654] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:39.115118 9505 tablet_bootstrap.cc:654] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:39.115115 9508 tablet_bootstrap.cc:654] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:39.116358 9507 tablet_bootstrap.cc:492] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: No bootstrap required, opened a new log
I20260811 12:40:39.116526 9507 ts_tablet_manager.cc:1397] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 12:40:39.117425 9508 tablet_bootstrap.cc:492] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: No bootstrap required, opened a new log
I20260811 12:40:39.117646 9508 ts_tablet_manager.cc:1397] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260811 12:40:39.117405 9507 raft_consensus.cc:348] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.117734 9507 raft_consensus.cc:374] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:39.117858 9507 raft_consensus.cc:729] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5e8cfc5bc54f3a801eecf84e758b87, State: Initialized, Role: FOLLOWER
I20260811 12:40:39.118294 9505 tablet_bootstrap.cc:492] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: No bootstrap required, opened a new log
I20260811 12:40:39.118173 9507 consensus_queue.cc:260] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.118479 9505 ts_tablet_manager.cc:1397] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 12:40:39.118458 9508 raft_consensus.cc:348] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.118753 9508 raft_consensus.cc:374] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:39.118851 9508 raft_consensus.cc:729] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bb570a462642a689a72ca6ae0711f6, State: Initialized, Role: FOLLOWER
I20260811 12:40:39.119112 9508 consensus_queue.cc:260] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.119625 9505 raft_consensus.cc:348] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.120028 9505 raft_consensus.cc:374] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:39.120225 9505 raft_consensus.cc:729] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29264604b4f422292ae945ac3f91c0e, State: Initialized, Role: FOLLOWER
I20260811 12:40:39.120699 9505 consensus_queue.cc:260] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.123819 9515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.122363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:57345)
0811 12:40:39.123125 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.123399 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"threads_started":1}
I20260811 12:40:39.124552 9505 ts_tablet_manager.cc:1428] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 12:40:39.126174 9508 ts_tablet_manager.cc:1428] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Time spent starting tablet: real 0.008s user 0.000s sys 0.008s
I20260811 12:40:39.126626 9515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.125145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:54959)
0811 12:40:39.126360 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.126471 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260811 12:40:39.127794 9396 heartbeater.cc:503] Master 127.0.186.124:40917 was elected leader, sending a full tablet report...
I20260811 12:40:39.129792 9516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.126756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:60117)
0811 12:40:39.129393 (+ 2637us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.129539 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2501,"threads_started":1}
I20260811 12:40:39.129995 9507 ts_tablet_manager.cc:1428] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Time spent starting tablet: real 0.013s user 0.003s sys 0.008s
I20260811 12:40:39.131811 9517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.130641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:38395)
0811 12:40:39.131344 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.131496 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":361,"threads_started":1}
I20260811 12:40:39.133481 9517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.132534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:53171)
0811 12:40:39.133204 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.133306 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557}
I20260811 12:40:39.133694 9228 heartbeater.cc:503] Master 127.0.186.124:40917 was elected leader, sending a full tablet report...
I20260811 12:40:39.134542 9516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.134161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:60529)
0811 12:40:39.134355 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.134425 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 12:40:39.201838 9514 raft_consensus.cc:482] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:39.202117 9514 raft_consensus.cc:504] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.202877 9514 leader_election.cc:288] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865), fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959)
I20260811 12:40:39.203698 9175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae2cd51f86c4c6cb4eea24e7de6dd42" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" is_pre_election: true
I20260811 12:40:39.203698 9003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae2cd51f86c4c6cb4eea24e7de6dd42" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bb570a462642a689a72ca6ae0711f6" is_pre_election: true
I20260811 12:40:39.203994 9003 raft_consensus.cc:2454] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 0.
I20260811 12:40:39.204069 9175 raft_consensus.cc:2454] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 0.
I20260811 12:40:39.204578 9264 leader_election.cc:302] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e29264604b4f422292ae945ac3f91c0e, fb5e8cfc5bc54f3a801eecf84e758b87; no voters:
I20260811 12:40:39.204898 9514 raft_consensus.cc:2781] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:39.205155 9514 raft_consensus.cc:482] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:39.205299 9514 raft_consensus.cc:3037] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:39.207543 9514 raft_consensus.cc:504] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.208140 9514 leader_election.cc:288] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 election: Requested vote from peers a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865), fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959)
I20260811 12:40:39.208627 9003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae2cd51f86c4c6cb4eea24e7de6dd42" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bb570a462642a689a72ca6ae0711f6"
I20260811 12:40:39.208657 9175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae2cd51f86c4c6cb4eea24e7de6dd42" candidate_uuid: "e29264604b4f422292ae945ac3f91c0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87"
I20260811 12:40:39.208880 9003 raft_consensus.cc:3037] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:39.208925 9175 raft_consensus.cc:3037] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:39.211089 9003 raft_consensus.cc:2454] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 1.
I20260811 12:40:39.211318 9175 raft_consensus.cc:2454] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29264604b4f422292ae945ac3f91c0e in term 1.
I20260811 12:40:39.211609 9264 leader_election.cc:302] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bb570a462642a689a72ca6ae0711f6, e29264604b4f422292ae945ac3f91c0e; no voters:
I20260811 12:40:39.211937 9514 raft_consensus.cc:2781] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:39.212468 9514 raft_consensus.cc:686] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 1 LEADER]: Becoming Leader. State: Replica: e29264604b4f422292ae945ac3f91c0e, State: Running, Role: LEADER
I20260811 12:40:39.213083 9514 consensus_queue.cc:237] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } }
I20260811 12:40:39.213637 9515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.213160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:54783)
0811 12:40:39.213340 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.213435 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 12:40:39.215946 8849 catalog_manager.cc:5495] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e reported cstate change: term changed from 0 to 1, leader changed from <none> to e29264604b4f422292ae945ac3f91c0e (127.0.186.67). New cstate: current_term: 1 leader_uuid: "e29264604b4f422292ae945ac3f91c0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29264604b4f422292ae945ac3f91c0e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:39.261281 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.256064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54484 (local address 127.0.186.67:45863)
0811 12:40:39.256310 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.256318 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.256412 (+ 94us) server_negotiation.cc:407] Connection header received
0811 12:40:39.256679 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.256684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.256830 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.257047 (+ 217us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:39.257428 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.258248 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.259526 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.259984 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.260124 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.260519 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:39.260618 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:39.260716 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.260926 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.261010 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 12:40:39.264626 9175 raft_consensus.cc:1261] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Refusing update from remote peer e29264604b4f422292ae945ac3f91c0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:39.264671 9003 raft_consensus.cc:1261] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Refusing update from remote peer e29264604b4f422292ae945ac3f91c0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:39.265408 9518 consensus_queue.cc:1035] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bb570a462642a689a72ca6ae0711f6" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:39.265832 9514 consensus_queue.cc:1035] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb5e8cfc5bc54f3a801eecf84e758b87" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:39.267912 9060 heartbeater.cc:503] Master 127.0.186.124:40917 was elected leader, sending a full tablet report...
I20260811 12:40:39.268301 9517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.267644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:49041)
0811 12:40:39.267978 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.268098 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
I20260811 12:40:39.269552 9516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.268832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:35697)
0811 12:40:39.269048 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.269239 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 12:40:39.280339 9517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.279821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.66:41817)
0811 12:40:39.280046 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.280141 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 12:40:39.291805 9515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.291143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:42847)
0811 12:40:39.291468 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.291593 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196}
I20260811 12:40:39.297515 9515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.295661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.67:53919)
0811 12:40:39.297216 (+ 1555us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.297322 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1429}
I20260811 12:40:39.298441 9516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.297703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.186.65:35869)
0811 12:40:39.298095 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.298227 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247}
I20260811 12:40:39.298794 9523 mvcc.cc:205] Tried to move back new op lower bound from 7317307552821116928 to 7317307552619466752. Current Snapshot: MvccSnapshot[applied={T|T < 7317307552821116928}]
I20260811 12:40:39.300138 8849 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:39.300422 8849 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:39.307070 8849 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc25b7d657ec4a13a82006ffb09976ef: Sending DeleteTablet for 3 replicas of tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42
I20260811 12:40:39.308074 9316 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:39 UTC) from {username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:54476
I20260811 12:40:39.308163 8981 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:39 UTC) from {username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:57780
I20260811 12:40:39.308566 9152 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:39 UTC) from {username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:36122
I20260811 12:40:39.308832 8980 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:39 UTC) from {username='oryx', principal='oryx/127.0.186.124@KRBTEST.COM'} at 127.0.0.1:57780
I20260811 12:40:39.313686 9532 tablet_replica.cc:330] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: stopping tablet replica
I20260811 12:40:39.313861 9531 tablet_replica.cc:330] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: stopping tablet replica
I20260811 12:40:39.313951 9532 raft_consensus.cc:2229] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:39.314144 9531 raft_consensus.cc:2229] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:39.314234 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 8830
I20260811 12:40:39.314297 9532 raft_consensus.cc:2258] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:39.314550 9533 tablet_replica.cc:330] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: stopping tablet replica
I20260811 12:40:39.314689 9531 raft_consensus.cc:2258] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:39.315944 9531 ts_tablet_manager.cc:1905] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:39.315999 9532 ts_tablet_manager.cc:1905] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:39.314775 9533 raft_consensus.cc:2229] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:39.318282 9533 raft_consensus.cc:2258] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:39.319437 9533 ts_tablet_manager.cc:1905] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:39.323421 9531 ts_tablet_manager.cc:1918] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:39.323580 9531 log.cc:1196] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/6ae2cd51f86c4c6cb4eea24e7de6dd42
I20260811 12:40:39.324052 9531 ts_tablet_manager.cc:1939] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P e29264604b4f422292ae945ac3f91c0e: Deleting consensus metadata
I20260811 12:40:39.325071 9532 ts_tablet_manager.cc:1918] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:39.325397 8833 catalog_manager.cc:4841] TS e29264604b4f422292ae945ac3f91c0e (127.0.186.67:45863): tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 (table test-table [id=da4ded6a771b4fcb9124f6eeb519beca]) successfully deleted
I20260811 12:40:39.325488 9532 log.cc:1196] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/6ae2cd51f86c4c6cb4eea24e7de6dd42
I20260811 12:40:39.326067 9532 ts_tablet_manager.cc:1939] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P a6bb570a462642a689a72ca6ae0711f6: Deleting consensus metadata
I20260811 12:40:39.326886 9533 ts_tablet_manager.cc:1918] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:39.327185 9533 log.cc:1196] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/6ae2cd51f86c4c6cb4eea24e7de6dd42
I20260811 12:40:39.327364 8836 catalog_manager.cc:4841] TS a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865): tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 (table test-table [id=da4ded6a771b4fcb9124f6eeb519beca]) successfully deleted
I20260811 12:40:39.327757 9533 ts_tablet_manager.cc:1939] T 6ae2cd51f86c4c6cb4eea24e7de6dd42 P fb5e8cfc5bc54f3a801eecf84e758b87: Deleting consensus metadata
W20260811 12:40:39.327931 8836 catalog_manager.cc:4808] TS a6bb570a462642a689a72ca6ae0711f6 (127.0.186.65:37865): delete failed for tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 because the tablet was not found. No further retry: Not found: Tablet not found: 6ae2cd51f86c4c6cb4eea24e7de6dd42
I20260811 12:40:39.329002 8836 catalog_manager.cc:4841] TS fb5e8cfc5bc54f3a801eecf84e758b87 (127.0.186.66:42959): tablet 6ae2cd51f86c4c6cb4eea24e7de6dd42 (table test-table [id=da4ded6a771b4fcb9124f6eeb519beca]) successfully deleted
I20260811 12:40:39.335318 9501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.315730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57782 (local address 127.0.186.65:37865)
0811 12:40:39.315926 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.315935 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.318028 (+ 2093us) server_negotiation.cc:407] Connection header received
0811 12:40:39.318316 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.318322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.318427 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.318511 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:39.320871 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.322092 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.324129 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.324859 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.324973 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.329333 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:39.329347 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:39.329363 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:39.329404 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:39.332359 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:39.333193 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:39.333201 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:39.333203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:39.333346 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:39.333718 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:39.333722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:39.333724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:39.334171 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:39.334409 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.334757 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.334998 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 12:40:39.336052 9054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:39.435753 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 8830
I20260811 12:40:39.458858 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 9076
I20260811 12:40:39.474779 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.459665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36130 (local address 127.0.186.66:42959)
0811 12:40:39.459882 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.459886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.459904 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:40:39.460093 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.460098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.460185 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.460280 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:39.461811 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.462600 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.463945 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.464356 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.464458 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.467649 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:39.467670 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:39.467695 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:39.467731 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:39.471605 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:39.472373 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:39.472381 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:39.472384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:39.472588 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:39.473080 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:39.473084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:39.473086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:39.473501 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:39.473753 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.474203 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.474395 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:40:39.475732 9222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:39.546267 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.545726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49572)
0811 12:40:39.545948 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.546070 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 12:40:39.547466 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.547041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39593 (local address 127.0.0.1:49578)
0811 12:40:39.547213 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:39.547306 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 12:40:39.576341 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 9076
I20260811 12:40:39.602028 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 9242
I20260811 12:40:39.617015 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:39.603006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54492 (local address 127.0.186.67:45863)
0811 12:40:39.603187 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:39.603191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:39.603209 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:40:39.603269 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:39.603273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:39.603337 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:39.603423 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:39.604942 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.605847 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.607210 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:39.607648 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:39.607749 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:39.610806 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:39.610824 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:39.610841 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:39.610883 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:39.614057 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:39.614818 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:39.614826 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:39.614828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:39.614987 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:39.615361 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:39.615365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:39.615367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:39.615780 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:39.616021 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:39.616408 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 12:40:39.616618 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 12:40:39.617820 9388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:39.747807 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 9242
I20260811 12:40:39.777746 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 8464
I20260811 12:40:39.778976 8661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:39.904160 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 8464
I20260811 12:40:39.932093 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 8583
I20260811 12:40:39.933362 8885 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:40.063798 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 8583
2026-08-11T12:40:40Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10668 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:40 dist-test-slave-qg60 krb5kdc[9546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:40 dist-test-slave-qg60 krb5kdc[9546](info): set up 2 sockets
Aug 11 12:40:40 dist-test-slave-qg60 krb5kdc[9546](info): commencing operation
krb5kdc: starting...
W20260811 12:40:41.291230 745 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:41 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:41Z Disabled control of system clock
WARNING: no policy specified for oryx/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab.
Entry for principal oryx/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab.
I20260811 12:40:41.608461 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45569
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab
--principal=oryx/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:37139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:45569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:41.965703 9559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:41.966059 9559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:41.966166 9559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:41.973577 9559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:41.973695 9559 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 12:40:41.973738 9559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:41.973793 9559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:41.973846 9559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:41.973912 9559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:41.983784 9559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:37139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:45569
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.126.keytab
--principal=oryx/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:41.985100 9559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:41.986408 9559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:41.999684 9566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:41.999791 9565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:41.999634 9568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:42.001186 9559 server_base.cc:1034] running on GCE node
I20260811 12:40:42.002238 9559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:42.003926 9559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:42.005223 9559 hybrid_clock.cc:648] HybridClock initialized: now 1786452042005157 us; error 38 us; skew 500 ppm
I20260811 12:40:42.005621 9559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:42 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452042, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:42.015990 9559 init.cc:377] Logged in from keytab as oryx/127.0.186.126@KRBTEST.COM (short username oryx)
I20260811 12:40:42.017951 9559 webserver.cc:460] Webserver started at http://127.0.186.126:38935/ using document root <none> and password file <none>
I20260811 12:40:42.018829 9559 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:42.018981 9559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:42.019358 9559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:42.023095 9559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "5cd298e6d3b44a59b37cfe8ee32992d2"
format_stamp: "Formatted at 2026-08-11 12:40:42 on dist-test-slave-qg60"
server_key: "9846a1373bae293fff0409390977ce60"
server_key_iv: "4f2a1d2d6386ce2a1ce900a83a12de3a"
server_key_version: "encryptionkey@0"
I20260811 12:40:42.023985 9559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "5cd298e6d3b44a59b37cfe8ee32992d2"
format_stamp: "Formatted at 2026-08-11 12:40:42 on dist-test-slave-qg60"
server_key: "9846a1373bae293fff0409390977ce60"
server_key_iv: "4f2a1d2d6386ce2a1ce900a83a12de3a"
server_key_version: "encryptionkey@0"
I20260811 12:40:42.029786 9559 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 12:40:42.033671 9576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:42.035256 9559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:42.035463 9559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "5cd298e6d3b44a59b37cfe8ee32992d2"
format_stamp: "Formatted at 2026-08-11 12:40:42 on dist-test-slave-qg60"
server_key: "9846a1373bae293fff0409390977ce60"
server_key_iv: "4f2a1d2d6386ce2a1ce900a83a12de3a"
server_key_version: "encryptionkey@0"
I20260811 12:40:42.035706 9559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:42.048856 9559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:42.053426 9559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:42.053720 9559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:42.077673 9559 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:45569
I20260811 12:40:42.077695 9645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:45569 every 8 connection(s)
I20260811 12:40:42.079155 9559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:42.080322 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 9559
I20260811 12:40:42.080607 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:42.081573 745 external_mini_cluster.cc:1428] Setting key b26c8b1d11840315d52e2313235de44a
I20260811 12:40:42.084501 9646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:40:42 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:42.098320 9646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Bootstrap starting.
I20260811 12:40:42.101637 9646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:42.103178 9646 log.cc:824] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:42.106235 9651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:42.083877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.0.186.126:45569)
0811 12:40:42.084785 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:42.084806 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:42.084852 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:40:42.086568 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:42.086589 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:42.087001 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:42.087369 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:42.089349 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.090793 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.092550 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.093398 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.093556 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:42.098338 (+ 4782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:42.098346 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:42.098360 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:42.098396 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:42.101641 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:42.102363 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:42.102371 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:42.102378 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:42.102555 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:42.102953 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:42.102959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:42.102962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:42.103573 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:42.103894 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:42.104409 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 12:40:42.104913 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":401,"threads_started":1}
I20260811 12:40:42.106901 9646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: No bootstrap required, opened a new log
I20260811 12:40:42.114950 9646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45569 } }
I20260811 12:40:42.115321 9646 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:42.115388 9646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cd298e6d3b44a59b37cfe8ee32992d2, State: Initialized, Role: FOLLOWER
I20260811 12:40:42.115942 9646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45569 } }
I20260811 12:40:42.116160 9646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:42.116324 9646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:42.116511 9646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:42.119161 9646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45569 } }
I20260811 12:40:42.119711 9646 leader_election.cc:302] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cd298e6d3b44a59b37cfe8ee32992d2; no voters:
I20260811 12:40:42.120378 9646 leader_election.cc:288] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:42.120566 9653 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:42.121337 9653 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5cd298e6d3b44a59b37cfe8ee32992d2, State: Running, Role: LEADER
I20260811 12:40:42.121907 9653 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45569 } }
I20260811 12:40:42.122632 9646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:42.125145 9654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45569 } } }
I20260811 12:40:42.125684 9654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:42.125376 9655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cd298e6d3b44a59b37cfe8ee32992d2. Latest consensus state: current_term: 1 leader_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cd298e6d3b44a59b37cfe8ee32992d2" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45569 } } }
I20260811 12:40:42.126253 9655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2 [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:42.128546 9662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:42.134302 9662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:42.145126 9662 catalog_manager.cc:1347] Generated new cluster ID: c7158a21476f4f38b563c1d29c0b835e
I20260811 12:40:42.145239 9662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:42.180996 9662 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:42.182569 9662 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:42.194527 9662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Generated new TSK 0
I20260811 12:40:42.195772 9662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab.
Entry for principal oryx/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab.
I20260811 12:40:42.282241 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45569
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:37139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:42.664870 9676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:42.665220 9676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:42.665400 9676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:42.672864 9676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:42.673026 9676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:42.673189 9676 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:40:42.673336 9676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:42.683794 9676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:37139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:42.685328 9676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:42.686758 9676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:42.701195 9681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:42.701172 9682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:42.701421 9684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:42.701817 9676 server_base.cc:1034] running on GCE node
I20260811 12:40:42.702539 9676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:42.703619 9676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:42.704885 9676 hybrid_clock.cc:648] HybridClock initialized: now 1786452042704804 us; error 56 us; skew 500 ppm
I20260811 12:40:42.705265 9676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:42 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452042, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:42.708846 9676 init.cc:377] Logged in from keytab as oryx/127.0.186.65@KRBTEST.COM (short username oryx)
I20260811 12:40:42.710549 9676 webserver.cc:460] Webserver started at http://127.0.186.65:45477/ using document root <none> and password file <none>
I20260811 12:40:42.711316 9676 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:42.711457 9676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:42.711802 9676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:42.715039 9676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "63f3fde6a711468da34c2297a794d97b"
format_stamp: "Formatted at 2026-08-11 12:40:42 on dist-test-slave-qg60"
server_key: "d0718bcc05db981c691fcf73c63a5848"
server_key_iv: "c64e37dd98394fc20266f51dffa7d146"
server_key_version: "encryptionkey@0"
I20260811 12:40:42.715900 9676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "63f3fde6a711468da34c2297a794d97b"
format_stamp: "Formatted at 2026-08-11 12:40:42 on dist-test-slave-qg60"
server_key: "d0718bcc05db981c691fcf73c63a5848"
server_key_iv: "c64e37dd98394fc20266f51dffa7d146"
server_key_version: "encryptionkey@0"
I20260811 12:40:42.721668 9676 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 12:40:42.726020 9692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:42.727599 9676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:42.727792 9676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "63f3fde6a711468da34c2297a794d97b"
format_stamp: "Formatted at 2026-08-11 12:40:42 on dist-test-slave-qg60"
server_key: "d0718bcc05db981c691fcf73c63a5848"
server_key_iv: "c64e37dd98394fc20266f51dffa7d146"
server_key_version: "encryptionkey@0"
I20260811 12:40:42.728080 9676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:42.742177 9676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:42.748929 9676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:42.749271 9676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:42.752700 9676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:42.752846 9676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 12:40:42.753023 9676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:42.753108 9676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:40:42 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452042, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:42.780058 9701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:42.753469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:48733 (local address 127.0.186.126:45569)
0811 12:40:42.757206 (+ 3737us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:42.757217 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:42.757250 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:40:42.758416 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:42.758425 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:42.758539 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:42.758698 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:42.760387 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.761698 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.765019 (+ 3321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.765708 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.765893 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:42.771644 (+ 5751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:42.771650 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:42.771654 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:42.771697 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:42.775139 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:42.776523 (+ 1384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:42.776531 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:42.776538 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:42.776745 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:42.777456 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:42.777463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:42.777469 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:42.777929 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:42.778106 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:42.779358 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0811 12:40:42.779628 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3568,"thread_start_us":3441,"threads_started":1}
I20260811 12:40:42.781708 9702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:42.754180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.186.65:48733)
0811 12:40:42.755352 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:42.755439 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:42.758092 (+ 2653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:42.758920 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:42.758928 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:42.759506 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:42.760190 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:42.760210 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.761893 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.761904 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:42.764734 (+ 2830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:42.764798 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.766032 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.766043 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:42.766468 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:42.767433 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:42.767478 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:42.771330 (+ 3852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:42.775386 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:42.775396 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:42.775419 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:42.776337 (+ 918us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:42.776914 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:42.776919 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:42.776922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:42.777248 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:42.778133 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:42.778146 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:42.778760 (+ 614us) client_negotiation.cc:769] Sending connection context
0811 12:40:42.779230 (+ 470us) client_negotiation.cc:240] Negotiation successful
0811 12:40:42.779862 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":431,"threads_started":1}
I20260811 12:40:42.812343 9701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:42.791970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:56695 (local address 127.0.186.126:45569)
0811 12:40:42.792204 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:42.792214 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:42.793277 (+ 1063us) server_negotiation.cc:407] Connection header received
0811 12:40:42.793497 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:42.793506 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:42.793617 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:42.793744 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:42.795530 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.796392 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.799344 (+ 2952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.800277 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.800478 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:42.803565 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:42.803571 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:42.803575 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:42.803623 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:42.808126 (+ 4503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:42.809500 (+ 1374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:42.809505 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:42.809508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:42.809662 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:42.810275 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:42.810284 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:42.810290 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:42.810716 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:42.810850 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:42.811688 (+ 838us) server_negotiation.cc:299] Negotiation successful
0811 12:40:42.812013 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 12:40:42.812501 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:42.792168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.186.65:56695)
0811 12:40:42.793149 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:42.793172 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:42.793352 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:42.793808 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:42.793817 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:42.794680 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:42.795313 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:42.795335 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.796563 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.796571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:42.799050 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:42.799075 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:42.800591 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:42.800603 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:42.800918 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:42.801834 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:42.801866 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:42.803259 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:42.808346 (+ 5087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:42.808355 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:42.808362 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:42.809293 (+ 931us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:42.809801 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:42.809809 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:42.809815 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:42.810036 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:42.810859 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:42.810866 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:42.811277 (+ 411us) client_negotiation.cc:769] Sending connection context
0811 12:40:42.811492 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 12:40:42.812003 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":684,"threads_started":1}
I20260811 12:40:42.814563 9676 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:37887
I20260811 12:40:42.814608 9827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:37887 every 8 connection(s)
I20260811 12:40:42.816239 9676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:42.818078 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 9676
I20260811 12:40:42.818279 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:42.819046 745 external_mini_cluster.cc:1428] Setting key fa5ba1e62ff1b2364335e559ec107262
I20260811 12:40:42.819994 9828 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45569
I20260811 12:40:42.820284 9828 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:42.821254 9828 heartbeater.cc:511] Master 127.0.186.126:45569 requested a full tablet report, sending...
I20260811 12:40:42.823858 9595 ts_manager.cc:194] Registered new tserver with Master: 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887)
I20260811 12:40:42.825753 9595 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:48733
WARNING: no policy specified for oryx/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab.
Entry for principal oryx/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab.
I20260811 12:40:42.889348 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45569
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:37139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:43.247850 9832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:43.248217 9832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:43.248410 9832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:43.255935 9832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:43.256114 9832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:43.256289 9832 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:40:43.256448 9832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:43.266572 9832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:37139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:43.268026 9832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:43.269503 9832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:43.283639 9838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:43.283679 9841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:43.283588 9839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:43.284679 9832 server_base.cc:1034] running on GCE node
I20260811 12:40:43.285432 9832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:43.286552 9832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:43.287783 9832 hybrid_clock.cc:648] HybridClock initialized: now 1786452043287715 us; error 38 us; skew 500 ppm
I20260811 12:40:43.288061 9832 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:43 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452043, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:43.291517 9832 init.cc:377] Logged in from keytab as oryx/127.0.186.66@KRBTEST.COM (short username oryx)
I20260811 12:40:43.293471 9832 webserver.cc:460] Webserver started at http://127.0.186.66:46125/ using document root <none> and password file <none>
I20260811 12:40:43.294231 9832 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:43.294328 9832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:43.294699 9832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:43.298082 9832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "cf9b2e8b0931489c9940c0516adfcc60"
format_stamp: "Formatted at 2026-08-11 12:40:43 on dist-test-slave-qg60"
server_key: "0c75fb705341ecb05632157751f986c3"
server_key_iv: "844c64b3df31823b8ac7403955284ced"
server_key_version: "encryptionkey@0"
I20260811 12:40:43.298943 9832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "cf9b2e8b0931489c9940c0516adfcc60"
format_stamp: "Formatted at 2026-08-11 12:40:43 on dist-test-slave-qg60"
server_key: "0c75fb705341ecb05632157751f986c3"
server_key_iv: "844c64b3df31823b8ac7403955284ced"
server_key_version: "encryptionkey@0"
I20260811 12:40:43.304514 9832 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:40:43.308200 9848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:43.309866 9832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:43.310053 9832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "cf9b2e8b0931489c9940c0516adfcc60"
format_stamp: "Formatted at 2026-08-11 12:40:43 on dist-test-slave-qg60"
server_key: "0c75fb705341ecb05632157751f986c3"
server_key_iv: "844c64b3df31823b8ac7403955284ced"
server_key_version: "encryptionkey@0"
I20260811 12:40:43.310289 9832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:43.327085 9832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:43.331636 9832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:43.331938 9832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:43.335016 9832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:43.335141 9832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:43.335318 9832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:43.335402 9832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:40:43 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452043, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:43.362124 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.335538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:45273 (local address 127.0.186.126:45569)
0811 12:40:43.336181 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:43.336188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:43.337441 (+ 1253us) server_negotiation.cc:407] Connection header received
0811 12:40:43.339849 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:43.339855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:43.339947 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:43.340093 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:43.342551 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.343944 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.347443 (+ 3499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.348096 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.348244 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.353781 (+ 5537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:43.353791 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:43.353799 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:43.353855 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:43.357646 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:43.358849 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:43.358856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:43.358859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:43.359021 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:43.359701 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:43.359707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:43.359710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:43.360196 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:43.360363 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:43.361406 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0811 12:40:43.361652 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":292,"threads_started":1}
I20260811 12:40:43.363236 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.336292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.186.66:45273)
0811 12:40:43.337247 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:43.337294 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:43.339496 (+ 2202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:43.340344 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:43.340352 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:43.341208 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:43.342314 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.342344 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.344198 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.344210 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.347228 (+ 3018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.347258 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.348602 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.348613 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.348966 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.349974 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:43.350015 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:43.353492 (+ 3477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:43.357822 (+ 4330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:43.357832 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:43.357862 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:43.358626 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:43.359151 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:43.359157 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:43.359161 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:43.359513 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:43.360346 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:43.360355 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:43.360947 (+ 592us) client_negotiation.cc:769] Sending connection context
0811 12:40:43.361298 (+ 351us) client_negotiation.cc:240] Negotiation successful
0811 12:40:43.361892 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":378,"threads_started":1}
I20260811 12:40:43.384184 9832 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:36269
I20260811 12:40:43.384202 9985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:36269 every 8 connection(s)
I20260811 12:40:43.385906 9832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:43.388007 9951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.370792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.186.66:32907)
0811 12:40:43.371826 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:43.371852 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:43.372027 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:43.372463 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:43.372470 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:43.373172 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:43.373478 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.373488 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.374933 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.374937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.376279 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.376293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.377542 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.377568 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.377813 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.378696 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:43.378730 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:43.380147 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:43.384886 (+ 4739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:43.384890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:43.384893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:43.385336 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:43.385752 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:43.385755 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:43.385757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:43.385885 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:43.386644 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:43.386654 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:43.386879 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 12:40:43.387125 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 12:40:43.387528 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":562,"threads_started":1}
I20260811 12:40:43.388101 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.370711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:32907 (local address 127.0.186.126:45569)
0811 12:40:43.370908 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:43.370916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:43.371967 (+ 1051us) server_negotiation.cc:407] Connection header received
0811 12:40:43.372170 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:43.372178 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:43.372286 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:43.372408 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:43.373643 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.374786 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.376435 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.377259 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.377429 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.380384 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:43.380395 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:43.380403 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:43.380460 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:43.384745 (+ 4285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:43.385461 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:43.385468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:43.385473 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:43.385634 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:43.386008 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:43.386012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:43.386015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:43.386487 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:43.386689 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:43.387269 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 12:40:43.387621 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 12:40:43.388705 9986 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45569
I20260811 12:40:43.389132 9986 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:43.390615 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 9832
I20260811 12:40:43.390815 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:43.390837 9986 heartbeater.cc:511] Master 127.0.186.126:45569 requested a full tablet report, sending...
I20260811 12:40:43.391469 745 external_mini_cluster.cc:1428] Setting key 265fd15a796bc69a7c183f5d7bd3ace9
I20260811 12:40:43.393006 9595 ts_manager.cc:194] Registered new tserver with Master: cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269)
I20260811 12:40:43.393918 9595 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:45273
WARNING: no policy specified for oryx/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab.
Entry for principal oryx/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab.
I20260811 12:40:43.461072 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45569
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:37139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:43.829746 9828 heartbeater.cc:503] Master 127.0.186.126:45569 was elected leader, sending a full tablet report...
W20260811 12:40:43.842510 9990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:43.842891 9990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:43.843081 9990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:43.851502 9990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:43.851696 9990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:43.851850 9990 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 12:40:43.852010 9990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:43.862545 9990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:37139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.186.126:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:43.864106 9990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:43.865758 9990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:43.880527 9995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:43.880507 9998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:43.880564 9996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:43.882089 9990 server_base.cc:1034] running on GCE node
I20260811 12:40:43.882793 9990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:43.883852 9990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:43.885155 9990 hybrid_clock.cc:648] HybridClock initialized: now 1786452043885052 us; error 69 us; skew 500 ppm
I20260811 12:40:43.885505 9990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:43 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452043, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:43.889305 9990 init.cc:377] Logged in from keytab as oryx/127.0.186.67@KRBTEST.COM (short username oryx)
I20260811 12:40:43.890974 9990 webserver.cc:460] Webserver started at http://127.0.186.67:40643/ using document root <none> and password file <none>
I20260811 12:40:43.891861 9990 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:43.892042 9990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:43.892421 9990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:43.895963 9990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
format_stamp: "Formatted at 2026-08-11 12:40:43 on dist-test-slave-qg60"
server_key: "6a052f6c400dccfcbaa526fae8420b97"
server_key_iv: "e3589e589ced6eb548c39df26de79842"
server_key_version: "encryptionkey@0"
I20260811 12:40:43.897181 9990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
format_stamp: "Formatted at 2026-08-11 12:40:43 on dist-test-slave-qg60"
server_key: "6a052f6c400dccfcbaa526fae8420b97"
server_key_iv: "e3589e589ced6eb548c39df26de79842"
server_key_version: "encryptionkey@0"
I20260811 12:40:43.903234 9990 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260811 12:40:43.907357 10005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:43.909008 9990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:40:43.909209 9990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
format_stamp: "Formatted at 2026-08-11 12:40:43 on dist-test-slave-qg60"
server_key: "6a052f6c400dccfcbaa526fae8420b97"
server_key_iv: "e3589e589ced6eb548c39df26de79842"
server_key_version: "encryptionkey@0"
I20260811 12:40:43.909475 9990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:43.937318 9990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:43.942932 9990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:43.943272 9990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:43.946663 9990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:43.946795 9990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:43.947037 9990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:43.947166 9990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 11 12:40:43 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452043, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:43.977171 10016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.947290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:46637 (local address 127.0.186.126:45569)
0811 12:40:43.950628 (+ 3338us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:43.950634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:43.950657 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:40:43.953487 (+ 2830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:43.953508 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:43.953635 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:43.953794 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:43.957277 (+ 3483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.958456 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.961159 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.961779 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.961932 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.968078 (+ 6146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:43.968092 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:43.968101 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:43.968169 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:43.972990 (+ 4821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:43.974375 (+ 1385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:43.974382 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:43.974386 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:43.974548 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:43.975078 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:43.975086 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:43.975094 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:43.975389 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:43.975565 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:43.976393 (+ 828us) server_negotiation.cc:299] Negotiation successful
0811 12:40:43.976650 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3215,"thread_start_us":3091,"threads_started":1}
I20260811 12:40:43.978870 10017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.948223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.186.67:46637)
0811 12:40:43.949481 (+ 1258us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:43.949555 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:43.952945 (+ 3390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:43.954228 (+ 1283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:43.954243 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:43.955489 (+ 1246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:43.956957 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.956999 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.958739 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.958747 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.960955 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.960971 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.962308 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.962319 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.962762 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.964024 (+ 1262us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:43.964077 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:43.967676 (+ 3599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:43.973248 (+ 5572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:43.973262 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:43.973287 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:43.974193 (+ 906us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:43.974686 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:43.974692 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:43.974696 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:43.974933 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:43.975535 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:43.975545 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:43.975980 (+ 435us) client_negotiation.cc:769] Sending connection context
0811 12:40:43.976278 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 12:40:43.976960 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":505,"threads_started":1}
I20260811 12:40:44.005510 10016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.987560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44715 (local address 127.0.186.126:45569)
0811 12:40:43.987757 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:43.987761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:43.988672 (+ 911us) server_negotiation.cc:407] Connection header received
0811 12:40:43.988981 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:43.988988 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:43.989100 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:43.989235 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:43.991133 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.991900 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.994891 (+ 2991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.995447 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.995632 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.998425 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:43.998431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:43.998435 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:43.998473 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:44.002104 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:44.003245 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:44.003255 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:44.003257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:44.003408 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:44.003858 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:44.003867 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:44.003869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:44.004199 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:44.004378 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:44.004834 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 12:40:44.005104 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 12:40:44.005656 10105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:43.987760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.186.67:44715)
0811 12:40:43.988531 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:43.988549 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:43.988791 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:43.989340 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:43.989355 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:43.990270 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:43.990856 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.990879 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.992111 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.992121 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.994653 (+ 2532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:43.994673 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:43.995719 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:43.995727 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:43.995986 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:43.996908 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:43.996940 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:43.998196 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:44.002299 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:44.002308 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:44.002313 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:44.003071 (+ 758us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:44.003558 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:44.003563 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:44.003567 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:44.003713 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:44.004329 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:44.004334 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:44.004544 (+ 210us) client_negotiation.cc:769] Sending connection context
0811 12:40:44.004687 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 12:40:44.005150 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":428,"threads_started":1}
I20260811 12:40:44.013638 10135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:46675 every 8 connection(s)
I20260811 12:40:44.013690 9990 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:46675
I20260811 12:40:44.015497 9990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:44.018143 10136 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45569
I20260811 12:40:44.018450 10136 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:44.019307 10136 heartbeater.cc:511] Master 127.0.186.126:45569 requested a full tablet report, sending...
I20260811 12:40:44.021311 9595 ts_manager.cc:194] Registered new tserver with Master: fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:44.022143 9595 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:46637
I20260811 12:40:44.024991 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 9990
I20260811 12:40:44.025138 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:44.025555 745 external_mini_cluster.cc:1428] Setting key 402f05466a27e6d6908f0cd0c26821bd
I20260811 12:40:44.029345 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 12:40:44 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452044, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 12:40:44 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:44 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:44.396795 9986 heartbeater.cc:503] Master 127.0.186.126:45569 was elected leader, sending a full tablet report...
I20260811 12:40:45.024955 10136 heartbeater.cc:503] Master 127.0.186.126:45569 was elected leader, sending a full tablet report...
W20260811 12:40:45.214269 10146 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.122s user 0.000s sys 0.022s
W20260811 12:40:45.215845 10016 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:44.086525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.0.186.126:45569)
0811 12:40:44.086782 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:44.086788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:44.087138 (+ 350us) server_negotiation.cc:407] Connection header received
0811 12:40:44.087330 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:44.087336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:44.087429 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:44.087532 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:44.089027 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:44.089791 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:44.091130 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:44.091536 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:44.091636 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.215561 (+1123925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58664: BlockingRecv error: recv got EOF from 127.0.0.1:58664 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 11 12:40:45 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452044, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:45.236195 10016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.220782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58680 (local address 127.0.186.126:45569)
0811 12:40:45.221017 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.221024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.221267 (+ 243us) server_negotiation.cc:407] Connection header received
0811 12:40:45.221426 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.221430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.221499 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.221592 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:45.223028 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.223872 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.225319 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.225755 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.225869 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.230238 (+ 4369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:45.230244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:45.230247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:45.230286 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:45.233316 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:45.234176 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:45.234181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:45.234184 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:45.234331 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:45.234777 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:45.234781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:45.234784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:45.235153 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:45.235366 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.235700 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.235898 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 12:40:45.241185 9595 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:45.249200 9595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:45.284279 10164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.263280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:36269 (local address 127.0.0.1:53060)
0811 12:40:45.273620 (+ 10340us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.273674 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.274636 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.276219 (+ 1583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.276224 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.276248 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.276675 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.276693 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.278913 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.278919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.281253 (+ 2334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.281266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.283248 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.283256 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.283497 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.283537 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.283666 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.283858 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9955,"mutex_wait_us":84,"thread_start_us":12689,"threads_started":1}
I20260811 12:40:45.284222 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.263507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.0.186.66:36269)
0811 12:40:45.264533 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.264548 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.273852 (+ 9304us) server_negotiation.cc:407] Connection header received
0811 12:40:45.275258 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.275270 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.275601 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.275769 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.276900 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.278758 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.281412 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.283021 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.283192 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.283422 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.283727 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.283905 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":807,"threads_started":1}
I20260811 12:40:45.285748 10159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.265604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:46675 (local address 127.0.0.1:37288)
0811 12:40:45.275458 (+ 9854us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.275480 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.275602 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.276542 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.276548 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.276582 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.277769 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.277786 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.279559 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.279567 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.282384 (+ 2817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.282402 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.284822 (+ 2420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.284830 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.285004 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.285046 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.285142 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.285289 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9716,"mutex_wait_us":31,"thread_start_us":6961,"threads_started":1}
I20260811 12:40:45.285773 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.265920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37288 (local address 127.0.186.67:46675)
0811 12:40:45.275907 (+ 9987us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.275920 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.275952 (+ 32us) server_negotiation.cc:407] Connection header received
0811 12:40:45.276056 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.276064 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.276303 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.276533 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.278032 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.279398 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.282606 (+ 3208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.284267 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.284410 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.284626 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.285230 (+ 604us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.285400 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9776,"thread_start_us":9592,"threads_started":1}
I20260811 12:40:45.286942 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.263431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:37887 (local address 127.0.0.1:53454)
0811 12:40:45.275054 (+ 11623us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.275080 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.275241 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.276884 (+ 1643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.276888 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.276919 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.278038 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.278050 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.280015 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.280021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.283190 (+ 3169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.283208 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.286014 (+ 2806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.286020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.286213 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.286249 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.286382 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.286530 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11464,"mutex_wait_us":27,"thread_start_us":11315,"threads_started":1}
I20260811 12:40:45.286991 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.264116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53454 (local address 127.0.186.65:37887)
0811 12:40:45.276201 (+ 12085us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.276211 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.276240 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:40:45.276338 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.276349 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.276576 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.277040 (+ 464us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.278265 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.279836 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.283414 (+ 3578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.285456 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.285608 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.285837 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.286455 (+ 618us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.286657 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11919,"thread_start_us":11714,"threads_started":1}
I20260811 12:40:45.288580 9903 tablet_service.cc:1467] Processing CreateTablet for tablet e320347f7d244ae6a08ae8cbb308cec2 (DEFAULT_TABLE table=test-table [id=58b4ec54232c418abc5d439d20430f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:45.290392 9903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e320347f7d244ae6a08ae8cbb308cec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.291415 9748 tablet_service.cc:1467] Processing CreateTablet for tablet e320347f7d244ae6a08ae8cbb308cec2 (DEFAULT_TABLE table=test-table [id=58b4ec54232c418abc5d439d20430f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:45.291692 10062 tablet_service.cc:1467] Processing CreateTablet for tablet e320347f7d244ae6a08ae8cbb308cec2 (DEFAULT_TABLE table=test-table [id=58b4ec54232c418abc5d439d20430f00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:45.293505 10062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e320347f7d244ae6a08ae8cbb308cec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.293761 9748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e320347f7d244ae6a08ae8cbb308cec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.308450 10167 tablet_bootstrap.cc:492] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Bootstrap starting.
I20260811 12:40:45.313225 10167 tablet_bootstrap.cc:654] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.314821 10168 tablet_bootstrap.cc:492] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Bootstrap starting.
I20260811 12:40:45.315132 10167 log.cc:824] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:45.319085 10167 tablet_bootstrap.cc:492] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: No bootstrap required, opened a new log
I20260811 12:40:45.319435 10167 ts_tablet_manager.cc:1397] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 12:40:45.320892 10168 tablet_bootstrap.cc:654] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.322077 10168 log.cc:824] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:45.316978 10169 tablet_bootstrap.cc:492] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Bootstrap starting.
I20260811 12:40:45.326493 10169 tablet_bootstrap.cc:654] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.327557 10168 tablet_bootstrap.cc:492] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: No bootstrap required, opened a new log
I20260811 12:40:45.327920 10168 ts_tablet_manager.cc:1397] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s
I20260811 12:40:45.327977 10169 log.cc:824] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:45.329902 10167 raft_consensus.cc:348] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.330439 10167 raft_consensus.cc:374] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.330603 10167 raft_consensus.cc:729] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc6b840bcf44919bf11d5f91088b8e4, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.331331 10167 consensus_queue.cc:260] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.332059 10169 tablet_bootstrap.cc:492] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: No bootstrap required, opened a new log
I20260811 12:40:45.332414 10169 ts_tablet_manager.cc:1397] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260811 12:40:45.333410 10167 ts_tablet_manager.cc:1428] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
I20260811 12:40:45.337818 10168 raft_consensus.cc:348] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.338409 10168 raft_consensus.cc:374] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.338581 10168 raft_consensus.cc:729] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.339296 10168 consensus_queue.cc:260] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.341837 10168 ts_tablet_manager.cc:1428] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
I20260811 12:40:45.343510 10169 raft_consensus.cc:348] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.344064 10169 raft_consensus.cc:374] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.344197 10169 raft_consensus.cc:729] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3fde6a711468da34c2297a794d97b, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.344959 10169 consensus_queue.cc:260] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.346717 10169 ts_tablet_manager.cc:1428] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Time spent starting tablet: real 0.014s user 0.006s sys 0.007s
I20260811 12:40:45.384318 10176 raft_consensus.cc:482] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:45.384714 10176 raft_consensus.cc:504] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.386662 10176 leader_election.cc:288] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
W20260811 12:40:45.391175 9987 tablet.cc:2369] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:45.397229 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.387701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:49739 (local address 127.0.186.66:36269)
0811 12:40:45.387887 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.387892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.387981 (+ 89us) server_negotiation.cc:407] Connection header received
0811 12:40:45.388403 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.388410 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.388504 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.388593 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.389527 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.390717 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.394664 (+ 3947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.395927 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.396123 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.396204 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.396857 (+ 653us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.396999 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 12:40:45.397285 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.387151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:59727 (local address 127.0.186.67:46675)
0811 12:40:45.387408 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.387415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.388601 (+ 1186us) server_negotiation.cc:407] Connection header received
0811 12:40:45.388782 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.388789 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.388870 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.389005 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.389746 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.390801 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.394674 (+ 3873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.395981 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.396145 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.396211 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.396857 (+ 646us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.397069 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 12:40:45.397552 10177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.386932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:36269 (local address 127.0.186.65:49739)
0811 12:40:45.387838 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.387866 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.388158 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.388837 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.388841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.388870 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.389352 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.389362 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.390864 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.390870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.394471 (+ 3601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.394487 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.396359 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.396366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.396610 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.396682 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.396822 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.396990 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":245,"spinlock_wait_cycles":25472,"thread_start_us":957,"threads_started":1}
I20260811 12:40:45.397899 10178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.387174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:46675 (local address 127.0.186.65:59727)
0811 12:40:45.388478 (+ 1304us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.388495 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.388625 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.389029 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.389034 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.389077 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.389549 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.389565 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.391502 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.391508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.394471 (+ 2963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.394487 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.396334 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.396345 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.396618 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.396685 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.396815 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.396990 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"mutex_wait_us":206,"thread_start_us":1015,"threads_started":1}
I20260811 12:40:45.399093 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e320347f7d244ae6a08ae8cbb308cec2" candidate_uuid: "63f3fde6a711468da34c2297a794d97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" is_pre_election: true
I20260811 12:40:45.399148 9929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e320347f7d244ae6a08ae8cbb308cec2" candidate_uuid: "63f3fde6a711468da34c2297a794d97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf9b2e8b0931489c9940c0516adfcc60" is_pre_election: true
I20260811 12:40:45.399786 10083 raft_consensus.cc:2454] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f3fde6a711468da34c2297a794d97b in term 0.
I20260811 12:40:45.399786 9929 raft_consensus.cc:2454] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f3fde6a711468da34c2297a794d97b in term 0.
I20260811 12:40:45.400652 9694 leader_election.cc:302] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, fdc6b840bcf44919bf11d5f91088b8e4; no voters:
I20260811 12:40:45.401158 10176 raft_consensus.cc:2781] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:45.401325 10176 raft_consensus.cc:482] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:45.401437 10176 raft_consensus.cc:3037] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.403648 10176 raft_consensus.cc:504] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.404253 10176 leader_election.cc:288] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [CANDIDATE]: Term 1 election: Requested vote from peers cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:45.404845 9929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e320347f7d244ae6a08ae8cbb308cec2" candidate_uuid: "63f3fde6a711468da34c2297a794d97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf9b2e8b0931489c9940c0516adfcc60"
I20260811 12:40:45.404851 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e320347f7d244ae6a08ae8cbb308cec2" candidate_uuid: "63f3fde6a711468da34c2297a794d97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
I20260811 12:40:45.405066 9929 raft_consensus.cc:3037] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.405090 10083 raft_consensus.cc:3037] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.407371 9929 raft_consensus.cc:2454] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3fde6a711468da34c2297a794d97b in term 1.
I20260811 12:40:45.407421 10083 raft_consensus.cc:2454] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3fde6a711468da34c2297a794d97b in term 1.
I20260811 12:40:45.407860 9696 leader_election.cc:302] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:45.408185 10176 raft_consensus.cc:2781] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:45.408603 10176 raft_consensus.cc:686] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 1 LEADER]: Becoming Leader. State: Replica: 63f3fde6a711468da34c2297a794d97b, State: Running, Role: LEADER
I20260811 12:40:45.409160 10176 consensus_queue.cc:237] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.414570 9595 catalog_manager.cc:5495] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f3fde6a711468da34c2297a794d97b (127.0.186.65). New cstate: current_term: 1 leader_uuid: "63f3fde6a711468da34c2297a794d97b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:45.442051 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.436584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53470 (local address 127.0.186.65:37887)
0811 12:40:45.436841 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.436849 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.436871 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:40:45.436978 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.436982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.437083 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.437241 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:45.437638 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.438334 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.439808 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.440230 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.440368 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.440865 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:45.441441 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:45.441619 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.441674 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.441765 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:40:45.450608 10083 raft_consensus.cc:1261] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Refusing update from remote peer 63f3fde6a711468da34c2297a794d97b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:45.450640 9929 raft_consensus.cc:1261] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Refusing update from remote peer 63f3fde6a711468da34c2297a794d97b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:45.451691 10176 consensus_queue.cc:1035] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:45.452023 10179 consensus_queue.cc:1035] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:45.464769 10182 mvcc.cc:205] Tried to move back new op lower bound from 7317307578155278336 to 7317307577999806464. Current Snapshot: MvccSnapshot[applied={T|T < 7317307578155278336}]
I20260811 12:40:45.483198 9595 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:45.483448 9595 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:45.487718 9595 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Sending DeleteTablet for 3 replicas of tablet e320347f7d244ae6a08ae8cbb308cec2
I20260811 12:40:45.489050 9748 tablet_service.cc:1514] Processing DeleteTablet for tablet e320347f7d244ae6a08ae8cbb308cec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:45 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53454
I20260811 12:40:45.489089 9903 tablet_service.cc:1514] Processing DeleteTablet for tablet e320347f7d244ae6a08ae8cbb308cec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:45 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53060
I20260811 12:40:45.489280 10062 tablet_service.cc:1514] Processing DeleteTablet for tablet e320347f7d244ae6a08ae8cbb308cec2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:45 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:37288
I20260811 12:40:45.492360 9595 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:45.494274 9595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:45.504304 10194 tablet_replica.cc:330] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: stopping tablet replica
I20260811 12:40:45.504921 10194 raft_consensus.cc:2229] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:45.505743 10194 raft_consensus.cc:2258] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:45.508908 10061 tablet_service.cc:1467] Processing CreateTablet for tablet 326d61e0ab9e4a53a26f978a284aa6dd (DEFAULT_TABLE table=test-table [id=9c47e835df32482193af02b3fad8f73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:45.508965 9902 tablet_service.cc:1467] Processing CreateTablet for tablet 326d61e0ab9e4a53a26f978a284aa6dd (DEFAULT_TABLE table=test-table [id=9c47e835df32482193af02b3fad8f73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:45.509611 10061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 326d61e0ab9e4a53a26f978a284aa6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.509706 9902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 326d61e0ab9e4a53a26f978a284aa6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.514511 10196 tablet_replica.cc:330] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: stopping tablet replica
I20260811 12:40:45.515363 10196 raft_consensus.cc:2229] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:45.516007 10196 raft_consensus.cc:2258] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:45.517315 10167 tablet_bootstrap.cc:492] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Bootstrap starting.
I20260811 12:40:45.519488 10167 tablet_bootstrap.cc:654] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.519443 9748 tablet_service.cc:1467] Processing CreateTablet for tablet 326d61e0ab9e4a53a26f978a284aa6dd (DEFAULT_TABLE table=test-table [id=9c47e835df32482193af02b3fad8f73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:45.520092 9748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 326d61e0ab9e4a53a26f978a284aa6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.521317 10196 ts_tablet_manager.cc:1905] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:45.523732 10168 tablet_bootstrap.cc:492] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Bootstrap starting.
I20260811 12:40:45.525544 10168 tablet_bootstrap.cc:654] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.523511 10195 tablet_replica.cc:330] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: stopping tablet replica
I20260811 12:40:45.527539 10195 raft_consensus.cc:2229] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:45.532116 10169 tablet_bootstrap.cc:492] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Bootstrap starting.
I20260811 12:40:45.532835 10195 raft_consensus.cc:2258] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:45.534078 10169 tablet_bootstrap.cc:654] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.534531 10168 tablet_bootstrap.cc:492] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: No bootstrap required, opened a new log
I20260811 12:40:45.534678 10168 ts_tablet_manager.cc:1397] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260811 12:40:45.535609 10196 ts_tablet_manager.cc:1918] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:45.535532 10168 raft_consensus.cc:348] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.535806 10168 raft_consensus.cc:374] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.535830 10196 log.cc:1196] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/e320347f7d244ae6a08ae8cbb308cec2
I20260811 12:40:45.535902 10168 raft_consensus.cc:729] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.536149 10168 consensus_queue.cc:260] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.536715 10168 ts_tablet_manager.cc:1428] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 12:40:45.540763 10195 ts_tablet_manager.cc:1905] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:45.541356 10167 tablet_bootstrap.cc:492] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: No bootstrap required, opened a new log
I20260811 12:40:45.541360 10194 ts_tablet_manager.cc:1905] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:45.542387 10196 ts_tablet_manager.cc:1939] T e320347f7d244ae6a08ae8cbb308cec2 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting consensus metadata
I20260811 12:40:45.542558 10167 ts_tablet_manager.cc:1397] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.011s
I20260811 12:40:45.543519 10167 raft_consensus.cc:348] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.543772 10167 raft_consensus.cc:374] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.543879 10167 raft_consensus.cc:729] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc6b840bcf44919bf11d5f91088b8e4, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.544158 10167 consensus_queue.cc:260] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.544785 10167 ts_tablet_manager.cc:1428] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 12:40:45.548105 10169 tablet_bootstrap.cc:492] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: No bootstrap required, opened a new log
I20260811 12:40:45.548794 9578 catalog_manager.cc:4841] TS fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675): tablet e320347f7d244ae6a08ae8cbb308cec2 (table test-table [id=58b4ec54232c418abc5d439d20430f00]) successfully deleted
I20260811 12:40:45.548991 10169 ts_tablet_manager.cc:1397] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.004s
I20260811 12:40:45.549949 10169 raft_consensus.cc:348] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.550217 10169 raft_consensus.cc:374] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.550356 10169 raft_consensus.cc:729] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3fde6a711468da34c2297a794d97b, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.550670 10169 consensus_queue.cc:260] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.551295 10169 ts_tablet_manager.cc:1428] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 12:40:45.553112 10195 ts_tablet_manager.cc:1918] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:45.553342 10195 log.cc:1196] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/e320347f7d244ae6a08ae8cbb308cec2
I20260811 12:40:45.554009 10195 ts_tablet_manager.cc:1939] T e320347f7d244ae6a08ae8cbb308cec2 P cf9b2e8b0931489c9940c0516adfcc60: Deleting consensus metadata
I20260811 12:40:45.555958 9580 catalog_manager.cc:4841] TS cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269): tablet e320347f7d244ae6a08ae8cbb308cec2 (table test-table [id=58b4ec54232c418abc5d439d20430f00]) successfully deleted
I20260811 12:40:45.559744 10194 ts_tablet_manager.cc:1918] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:45.559947 10194 log.cc:1196] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/e320347f7d244ae6a08ae8cbb308cec2
I20260811 12:40:45.560591 10194 ts_tablet_manager.cc:1939] T e320347f7d244ae6a08ae8cbb308cec2 P 63f3fde6a711468da34c2297a794d97b: Deleting consensus metadata
I20260811 12:40:45.562562 9579 catalog_manager.cc:4841] TS 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887): tablet e320347f7d244ae6a08ae8cbb308cec2 (table test-table [id=58b4ec54232c418abc5d439d20430f00]) successfully deleted
W20260811 12:40:45.570900 9829 tablet.cc:2369] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:45.673789 10175 raft_consensus.cc:482] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:45.674079 10175 raft_consensus.cc:504] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.676198 10175 leader_election.cc:288] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:45.686303 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.677021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:60131 (local address 127.0.186.67:46675)
0811 12:40:45.677235 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.677241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.678969 (+ 1728us) server_negotiation.cc:407] Connection header received
0811 12:40:45.679291 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.679300 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.679394 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.679487 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.680197 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.681188 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.683814 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.685197 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.685378 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.685471 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.685885 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.686003 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 12:40:45.686677 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.677066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:59453 (local address 127.0.186.65:37887)
0811 12:40:45.677325 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.677335 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.679437 (+ 2102us) server_negotiation.cc:407] Connection header received
0811 12:40:45.679649 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.679662 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.679749 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.679807 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:40:45.680595 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.681805 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.684251 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.685553 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.685721 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.685819 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.686184 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.686330 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 12:40:45.686698 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.676542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:37887 (local address 127.0.186.66:59453)
0811 12:40:45.679288 (+ 2746us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.679305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.679445 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.679972 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.679975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.679995 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.680407 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.680429 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.681994 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.681999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.684083 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.684094 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.685778 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.685785 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.685993 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.686029 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.686130 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.686275 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2590,"mutex_wait_us":859,"thread_start_us":1499,"threads_started":1}
I20260811 12:40:45.687475 10201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.676545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:46675 (local address 127.0.186.66:60131)
0811 12:40:45.678852 (+ 2307us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.678874 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.679111 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.679558 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.679564 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.679594 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:40:45.679971 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.679983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.681324 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.681331 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.683619 (+ 2288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.683665 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.685442 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.685449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.685666 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.685703 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.686913 (+ 1210us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.687059 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2155,"mutex_wait_us":1,"thread_start_us":1955,"threads_started":1}
I20260811 12:40:45.687856 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "326d61e0ab9e4a53a26f978a284aa6dd" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b" is_pre_election: true
I20260811 12:40:45.688320 9779 raft_consensus.cc:2454] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:45.689093 9851 leader_election.cc:302] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:45.689358 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "326d61e0ab9e4a53a26f978a284aa6dd" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" is_pre_election: true
I20260811 12:40:45.689579 10175 raft_consensus.cc:2781] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:45.689661 10083 raft_consensus.cc:2454] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:45.689713 10175 raft_consensus.cc:482] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:45.689806 10175 raft_consensus.cc:3037] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.692330 10175 raft_consensus.cc:504] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.693080 10175 leader_election.cc:288] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Requested vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:45.693621 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "326d61e0ab9e4a53a26f978a284aa6dd" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b"
I20260811 12:40:45.693710 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "326d61e0ab9e4a53a26f978a284aa6dd" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
I20260811 12:40:45.693863 9779 raft_consensus.cc:3037] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.693955 10083 raft_consensus.cc:3037] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.696300 9779 raft_consensus.cc:2454] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:45.696803 9851 leader_election.cc:302] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:45.697142 10175 raft_consensus.cc:2781] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:45.697130 10083 raft_consensus.cc:2454] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:45.697892 10175 raft_consensus.cc:686] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Becoming Leader. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Running, Role: LEADER
I20260811 12:40:45.698360 10175 consensus_queue.cc:237] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.702659 9595 catalog_manager.cc:5495] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
Aug 11 12:40:45 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452042, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.126@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
W20260811 12:40:45.769035 10138 tablet.cc:2369] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:40:45.772864 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.755350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45569 (local address 127.0.0.1:58686)
0811 12:40:45.756524 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.756542 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.756687 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.757164 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.757168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.757992 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:45.758287 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.758297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.760000 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.760005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.761114 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.761130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.762220 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.762225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.762364 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.763202 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:45.763220 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:45.765973 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:45.770196 (+ 4223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:45.770208 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:45.770214 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:45.770656 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:45.771094 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:45.771098 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:45.771100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:45.771238 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:45.771905 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:45.771912 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:45.772129 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.772263 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.772474 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1007,"thread_start_us":815,"threads_started":1}
I20260811 12:40:45.773204 10215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.755478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58686 (local address 127.0.186.126:45569)
0811 12:40:45.756297 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.756303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.756646 (+ 343us) server_negotiation.cc:407] Connection header received
0811 12:40:45.756866 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.756872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.756957 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.757102 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:45.758547 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.759829 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.761290 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.762001 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.762149 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.766219 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:45.766226 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:45.766231 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:45.766273 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:45.770035 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:45.770799 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:45.770806 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:45.770810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:45.770979 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:45.771367 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:45.771372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:45.771375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:45.771762 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:45.771928 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.772451 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.772751 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":347,"threads_started":1}
I20260811 12:40:45.778715 9595 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:58686:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 12:40:45.779867 9595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:45.788607 9902 tablet_service.cc:1467] Processing CreateTablet for tablet 6034413395024d608c44d06838a1650a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e6960f49a182411a8aa0db32d45312df]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:40:45.788582 9748 tablet_service.cc:1467] Processing CreateTablet for tablet 6034413395024d608c44d06838a1650a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e6960f49a182411a8aa0db32d45312df]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:40:45.789280 9902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6034413395024d608c44d06838a1650a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.789345 9748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6034413395024d608c44d06838a1650a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.793948 10061 tablet_service.cc:1467] Processing CreateTablet for tablet 6034413395024d608c44d06838a1650a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e6960f49a182411a8aa0db32d45312df]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 12:40:45.794587 10061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6034413395024d608c44d06838a1650a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:45.795857 10168 tablet_bootstrap.cc:492] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: Bootstrap starting.
I20260811 12:40:45.797784 10168 tablet_bootstrap.cc:654] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.800028 10169 tablet_bootstrap.cc:492] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: Bootstrap starting.
I20260811 12:40:45.802438 10169 tablet_bootstrap.cc:654] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.803609 10168 tablet_bootstrap.cc:492] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: No bootstrap required, opened a new log
I20260811 12:40:45.803875 10168 ts_tablet_manager.cc:1397] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260811 12:40:45.804772 10168 raft_consensus.cc:348] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.805136 10168 raft_consensus.cc:374] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.805279 10168 raft_consensus.cc:729] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.805521 10167 tablet_bootstrap.cc:492] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: Bootstrap starting.
I20260811 12:40:45.805724 10168 consensus_queue.cc:260] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.806557 10168 ts_tablet_manager.cc:1428] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 12:40:45.807266 10167 tablet_bootstrap.cc:654] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:45.808585 10175 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.808945 10175 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.821694 10169 tablet_bootstrap.cc:492] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: No bootstrap required, opened a new log
I20260811 12:40:45.821938 10169 ts_tablet_manager.cc:1397] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.003s
I20260811 12:40:45.822834 10169 raft_consensus.cc:348] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.825341 10169 raft_consensus.cc:374] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.825711 10169 raft_consensus.cc:729] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3fde6a711468da34c2297a794d97b, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.826368 10169 consensus_queue.cc:260] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.827958 10187 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.828397 10187 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.829267 10169 ts_tablet_manager.cc:1428] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260811 12:40:45.829386 10167 tablet_bootstrap.cc:492] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: No bootstrap required, opened a new log
I20260811 12:40:45.829610 10167 ts_tablet_manager.cc:1397] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.012s
I20260811 12:40:45.830372 10167 raft_consensus.cc:348] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.831802 10167 raft_consensus.cc:374] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:45.831931 10167 raft_consensus.cc:729] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc6b840bcf44919bf11d5f91088b8e4, State: Initialized, Role: FOLLOWER
I20260811 12:40:45.832468 10167 consensus_queue.cc:260] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.833132 10174 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.833586 10174 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.835031 10167 ts_tablet_manager.cc:1428] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260811 12:40:45.885524 10175 raft_consensus.cc:482] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:45.885788 10175 raft_consensus.cc:504] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.886535 10175 leader_election.cc:288] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:45.887187 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034413395024d608c44d06838a1650a" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b" is_pre_election: true
I20260811 12:40:45.887277 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034413395024d608c44d06838a1650a" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" is_pre_election: true
I20260811 12:40:45.887537 10083 raft_consensus.cc:2454] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:45.887538 9779 raft_consensus.cc:2454] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:45.888136 9850 leader_election.cc:302] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60, fdc6b840bcf44919bf11d5f91088b8e4; no voters:
I20260811 12:40:45.888545 10175 raft_consensus.cc:2781] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:45.888685 10175 raft_consensus.cc:482] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:45.888823 10175 raft_consensus.cc:3037] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.892028 10175 raft_consensus.cc:504] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.893010 10175 leader_election.cc:288] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Requested vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:45.893203 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034413395024d608c44d06838a1650a" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b"
I20260811 12:40:45.893493 9779 raft_consensus.cc:3037] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.894181 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034413395024d608c44d06838a1650a" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
I20260811 12:40:45.894476 10083 raft_consensus.cc:3037] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:45.896046 9779 raft_consensus.cc:2454] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:45.896569 9851 leader_election.cc:302] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:45.896922 10175 raft_consensus.cc:2781] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:45.897116 10175 raft_consensus.cc:686] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Becoming Leader. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Running, Role: LEADER
I20260811 12:40:45.897375 10175 consensus_queue.cc:237] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:45.897604 10083 raft_consensus.cc:2454] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:45.899462 10205 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: TxnStatusTablet state changed. Reason: New leader cf9b2e8b0931489c9940c0516adfcc60. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.899832 10205 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:40:45.900599 10220 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 12:40:45.900874 10220 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 12:40:45.901348 9594 catalog_manager.cc:5495] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:45.938463 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.928256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:36269 (local address 127.0.0.1:53062)
0811 12:40:45.928684 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:45.928709 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:45.928950 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:45.930317 (+ 1367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:45.930323 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:45.930340 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:40:45.930596 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.930610 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.932813 (+ 2203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.932820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.934728 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:45.934749 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.936053 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.936061 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:45.936268 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.936358 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:40:45.937747 (+ 1389us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:40:45.937779 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 12:40:45.937914 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 12:40:45.938114 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245}
I20260811 12:40:45.938494 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.928263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53062 (local address 127.0.186.66:36269)
0811 12:40:45.929751 (+ 1488us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.929759 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.929797 (+ 38us) server_negotiation.cc:407] Connection header received
0811 12:40:45.929925 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.929931 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.930071 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.930263 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:45.930835 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.932556 (+ 1721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.935000 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.935820 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.936007 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.936681 (+ 674us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:45.937599 (+ 918us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:45.937759 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.937958 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.938062 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1314,"thread_start_us":1011,"threads_started":1}
I20260811 12:40:45.944105 9779 raft_consensus.cc:1261] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:45.945060 10083 raft_consensus.cc:1261] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:45.945252 10205 consensus_queue.cc:1035] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:45.945816 10175 consensus_queue.cc:1035] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:45.953754 10174 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: TxnStatusTablet state changed. Reason: New leader cf9b2e8b0931489c9940c0516adfcc60. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.954137 10174 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.958822 10205 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.959162 10205 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:40:45.960507 10183 mvcc.cc:205] Tried to move back new op lower bound from 7317307580176171008 to 7317307579999064064. Current Snapshot: MvccSnapshot[applied={T|T < 7317307580176171008 or (T in {7317307580176171008})}]
I20260811 12:40:45.961229 10174 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.961511 10174 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P fdc6b840bcf44919bf11d5f91088b8e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.962569 10184 mvcc.cc:205] Tried to move back new op lower bound from 7317307580176171008 to 7317307579999064064. Current Snapshot: MvccSnapshot[applied={T|T < 7317307580176171008 or (T in {7317307580176171008})}]
I20260811 12:40:45.969913 10187 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: TxnStatusTablet state changed. Reason: New leader cf9b2e8b0931489c9940c0516adfcc60. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.970270 10187 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.971344 10175 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.971784 10175 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P cf9b2e8b0931489c9940c0516adfcc60: This TxnStatusTablet replica's current role is: LEADER
I20260811 12:40:45.981355 10187 tablet_replica.cc:439] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } } }
I20260811 12:40:45.981695 10187 tablet_replica.cc:442] T 6034413395024d608c44d06838a1650a P 63f3fde6a711468da34c2297a794d97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 12:40:45.994463 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:45.986635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53070 (local address 127.0.186.66:36269)
0811 12:40:45.986827 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:45.986833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:45.987443 (+ 610us) server_negotiation.cc:407] Connection header received
0811 12:40:45.987633 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:45.987640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:45.987747 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:45.987852 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:45.988420 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.989702 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.992022 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:45.992717 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:45.992881 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:45.993579 (+ 698us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:45.993728 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:45.993828 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:45.994005 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 12:40:45.994100 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 12:40:46.018214 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:46.009125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:58937 (local address 127.0.186.66:36269)
0811 12:40:46.009389 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:46.009400 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:46.010255 (+ 855us) server_negotiation.cc:407] Connection header received
0811 12:40:46.010493 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:46.010498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:46.010624 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:46.010727 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:46.011451 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.012669 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.015372 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.016087 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.016231 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.017038 (+ 807us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:46.017205 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:46.017295 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:46.017549 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 12:40:46.017639 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":71}
I20260811 12:40:46.019487 10234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:46.009151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:36269 (local address 127.0.186.66:58937)
0811 12:40:46.010121 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:46.010144 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:46.010325 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:46.010772 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:46.010776 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:46.010790 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 12:40:46.011227 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:46.011240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.012853 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.012858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:46.015139 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:46.015157 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.016423 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.016429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:46.016622 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.016787 (+ 165us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 12:40:46.017416 (+ 629us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 12:40:46.017425 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 12:40:46.018878 (+ 1453us) client_negotiation.cc:240] Negotiation successful
0811 12:40:46.019045 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":509,"threads_started":1}
I20260811 12:40:46.032346 10083 raft_consensus.cc:1261] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:46.032419 9779 raft_consensus.cc:1261] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:46.033088 10228 consensus_queue.cc:1035] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:46.033675 10175 consensus_queue.cc:1035] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:46.132638 9595 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:46.132975 9595 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:46.136225 9595 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Sending DeleteTablet for 3 replicas of tablet 326d61e0ab9e4a53a26f978a284aa6dd
I20260811 12:40:46.137163 9748 tablet_service.cc:1514] Processing DeleteTablet for tablet 326d61e0ab9e4a53a26f978a284aa6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53454
I20260811 12:40:46.137421 9903 tablet_service.cc:1514] Processing DeleteTablet for tablet 326d61e0ab9e4a53a26f978a284aa6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53060
I20260811 12:40:46.137506 10061 tablet_service.cc:1514] Processing DeleteTablet for tablet 326d61e0ab9e4a53a26f978a284aa6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:37288
I20260811 12:40:46.148283 10239 tablet_replica.cc:330] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: stopping tablet replica
I20260811 12:40:46.148342 10238 tablet_replica.cc:330] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: stopping tablet replica
I20260811 12:40:46.148558 10238 raft_consensus.cc:2229] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:46.148694 10239 raft_consensus.cc:2229] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:46.149017 10238 raft_consensus.cc:2258] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.149487 10239 raft_consensus.cc:2258] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.150089 10240 tablet_replica.cc:330] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: stopping tablet replica
I20260811 12:40:46.150431 10238 ts_tablet_manager.cc:1905] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.151321 10239 ts_tablet_manager.cc:1905] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.151628 10240 raft_consensus.cc:2229] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:46.151980 10240 raft_consensus.cc:2258] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.157931 10240 ts_tablet_manager.cc:1905] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.157994 10238 ts_tablet_manager.cc:1918] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:40:46.158120 10238 log.cc:1196] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/326d61e0ab9e4a53a26f978a284aa6dd
I20260811 12:40:46.158710 10238 ts_tablet_manager.cc:1939] T 326d61e0ab9e4a53a26f978a284aa6dd P 63f3fde6a711468da34c2297a794d97b: Deleting consensus metadata
I20260811 12:40:46.160075 9579 catalog_manager.cc:4841] TS 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887): tablet 326d61e0ab9e4a53a26f978a284aa6dd (table test-table [id=9c47e835df32482193af02b3fad8f73c]) successfully deleted
I20260811 12:40:46.163990 10239 ts_tablet_manager.cc:1918] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:40:46.164161 10239 log.cc:1196] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/326d61e0ab9e4a53a26f978a284aa6dd
I20260811 12:40:46.164811 10239 ts_tablet_manager.cc:1939] T 326d61e0ab9e4a53a26f978a284aa6dd P cf9b2e8b0931489c9940c0516adfcc60: Deleting consensus metadata
I20260811 12:40:46.165793 10240 ts_tablet_manager.cc:1918] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:40:46.166204 10240 log.cc:1196] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/326d61e0ab9e4a53a26f978a284aa6dd
I20260811 12:40:46.166290 9580 catalog_manager.cc:4841] TS cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269): tablet 326d61e0ab9e4a53a26f978a284aa6dd (table test-table [id=9c47e835df32482193af02b3fad8f73c]) successfully deleted
I20260811 12:40:46.166841 10240 ts_tablet_manager.cc:1939] T 326d61e0ab9e4a53a26f978a284aa6dd P fdc6b840bcf44919bf11d5f91088b8e4: Deleting consensus metadata
I20260811 12:40:46.167850 9578 catalog_manager.cc:4841] TS fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675): tablet 326d61e0ab9e4a53a26f978a284aa6dd (table test-table [id=9c47e835df32482193af02b3fad8f73c]) successfully deleted
Aug 11 12:40:46 dist-test-slave-qg60 krb5kdc[9546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 12:40:46 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:46 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 12:40:46.229738 10215 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:46.217056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58698 (local address 127.0.186.126:45569)
0811 12:40:46.217328 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:46.217349 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:46.217793 (+ 444us) server_negotiation.cc:407] Connection header received
0811 12:40:46.218047 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:46.218052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:46.218168 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:46.218275 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:46.220252 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.221124 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.222565 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.222985 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.223125 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.229448 (+ 6323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58698: BlockingRecv error: recv got EOF from 127.0.0.1:58698 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 12:40:46 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM
I20260811 12:40:46.250131 10215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:46.233296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58702 (local address 127.0.186.126:45569)
0811 12:40:46.233521 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:46.233528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:46.233839 (+ 311us) server_negotiation.cc:407] Connection header received
0811 12:40:46.234000 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:46.234007 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:46.234099 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:46.234221 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:46.235541 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.236757 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.238125 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.238802 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.238939 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.243417 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:46.243425 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:46.243431 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:46.243492 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:46.247146 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:46.247858 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:46.247863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:46.247867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:46.248040 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:46.248445 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:46.248452 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:46.248455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:46.248899 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:46.249193 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:46.249463 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 12:40:46.249726 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:40:46.254379 9595 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58702:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:40:46.255152 9595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:46.263273 9748 tablet_service.cc:1467] Processing CreateTablet for tablet bf02a28d5ca34a48bb4f5ed67d1d0237 (DEFAULT_TABLE table=test-table [id=d5605aaa57a944a8af0ca80cdfb9c61a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:46.263556 10061 tablet_service.cc:1467] Processing CreateTablet for tablet bf02a28d5ca34a48bb4f5ed67d1d0237 (DEFAULT_TABLE table=test-table [id=d5605aaa57a944a8af0ca80cdfb9c61a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:46.263638 9903 tablet_service.cc:1467] Processing CreateTablet for tablet bf02a28d5ca34a48bb4f5ed67d1d0237 (DEFAULT_TABLE table=test-table [id=d5605aaa57a944a8af0ca80cdfb9c61a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:46.263794 9748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf02a28d5ca34a48bb4f5ed67d1d0237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:46.264014 10061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf02a28d5ca34a48bb4f5ed67d1d0237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:46.264133 9903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf02a28d5ca34a48bb4f5ed67d1d0237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:46.270803 10167 tablet_bootstrap.cc:492] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Bootstrap starting.
I20260811 12:40:46.270934 10169 tablet_bootstrap.cc:492] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Bootstrap starting.
I20260811 12:40:46.271931 10168 tablet_bootstrap.cc:492] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Bootstrap starting.
I20260811 12:40:46.272631 10169 tablet_bootstrap.cc:654] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:46.272639 10167 tablet_bootstrap.cc:654] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:46.273840 10168 tablet_bootstrap.cc:654] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:46.282740 10169 tablet_bootstrap.cc:492] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: No bootstrap required, opened a new log
I20260811 12:40:46.283061 10169 ts_tablet_manager.cc:1397] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260811 12:40:46.284041 10169 raft_consensus.cc:348] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.284504 10169 raft_consensus.cc:374] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:46.284674 10169 raft_consensus.cc:729] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3fde6a711468da34c2297a794d97b, State: Initialized, Role: FOLLOWER
I20260811 12:40:46.285066 10169 consensus_queue.cc:260] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.285279 10167 tablet_bootstrap.cc:492] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: No bootstrap required, opened a new log
I20260811 12:40:46.285502 10167 ts_tablet_manager.cc:1397] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260811 12:40:46.286418 10167 raft_consensus.cc:348] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.286773 10167 raft_consensus.cc:374] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:46.286914 10167 raft_consensus.cc:729] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc6b840bcf44919bf11d5f91088b8e4, State: Initialized, Role: FOLLOWER
I20260811 12:40:46.287002 10168 tablet_bootstrap.cc:492] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: No bootstrap required, opened a new log
I20260811 12:40:46.287195 10168 ts_tablet_manager.cc:1397] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260811 12:40:46.287322 10167 consensus_queue.cc:260] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.288146 10168 raft_consensus.cc:348] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.288482 10168 raft_consensus.cc:374] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:46.289256 10168 raft_consensus.cc:729] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Initialized, Role: FOLLOWER
I20260811 12:40:46.289428 10167 ts_tablet_manager.cc:1428] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 12:40:46.289671 10168 consensus_queue.cc:260] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.290258 10169 ts_tablet_manager.cc:1428] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 12:40:46.291474 10168 ts_tablet_manager.cc:1428] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 12:40:46.439391 10205 raft_consensus.cc:482] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:46.439707 10205 raft_consensus.cc:504] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.440505 10205 leader_election.cc:288] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:46.441143 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf02a28d5ca34a48bb4f5ed67d1d0237" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b" is_pre_election: true
I20260811 12:40:46.441149 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf02a28d5ca34a48bb4f5ed67d1d0237" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" is_pre_election: true
I20260811 12:40:46.441424 9779 raft_consensus.cc:2454] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:46.441442 10083 raft_consensus.cc:2454] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:46.441932 9851 leader_election.cc:302] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:46.442261 10205 raft_consensus.cc:2781] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:46.442420 10205 raft_consensus.cc:482] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:46.442556 10205 raft_consensus.cc:3037] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:46.444873 10205 raft_consensus.cc:504] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.445524 10205 leader_election.cc:288] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Requested vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:46.446059 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf02a28d5ca34a48bb4f5ed67d1d0237" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b"
I20260811 12:40:46.446117 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf02a28d5ca34a48bb4f5ed67d1d0237" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
I20260811 12:40:46.446290 9779 raft_consensus.cc:3037] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:46.446328 10083 raft_consensus.cc:3037] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:46.449363 10083 raft_consensus.cc:2454] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:46.449363 9779 raft_consensus.cc:2454] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:46.449813 9851 leader_election.cc:302] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:46.450126 10205 raft_consensus.cc:2781] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:46.450361 10205 raft_consensus.cc:686] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Becoming Leader. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Running, Role: LEADER
I20260811 12:40:46.450615 10205 consensus_queue.cc:237] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.453696 9595 catalog_manager.cc:5495] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:46.487738 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:46.481518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53084 (local address 127.0.186.66:36269)
0811 12:40:46.481707 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:46.481711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:46.482068 (+ 357us) server_negotiation.cc:407] Connection header received
0811 12:40:46.482203 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:46.482207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:46.482276 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:46.482360 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:40:46.482801 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.483651 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.485747 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.486260 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.486367 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.486931 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:40:46.487110 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:40:46.487185 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:46.487361 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 12:40:46.487431 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 12:40:46.491084 9779 raft_consensus.cc:1261] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:46.491194 10083 raft_consensus.cc:1261] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:46.491906 10175 consensus_queue.cc:1035] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:46.492270 10205 consensus_queue.cc:1035] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:46.511149 9594 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:46.511408 9594 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:46.514866 9594 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Sending DeleteTablet for 3 replicas of tablet bf02a28d5ca34a48bb4f5ed67d1d0237
I20260811 12:40:46.515872 9748 tablet_service.cc:1514] Processing DeleteTablet for tablet bf02a28d5ca34a48bb4f5ed67d1d0237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53454
I20260811 12:40:46.515920 9903 tablet_service.cc:1514] Processing DeleteTablet for tablet bf02a28d5ca34a48bb4f5ed67d1d0237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53060
I20260811 12:40:46.515987 10061 tablet_service.cc:1514] Processing DeleteTablet for tablet bf02a28d5ca34a48bb4f5ed67d1d0237 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:37288
I20260811 12:40:46.516218 10238 tablet_replica.cc:330] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: stopping tablet replica
I20260811 12:40:46.516330 10240 tablet_replica.cc:330] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: stopping tablet replica
I20260811 12:40:46.516434 10238 raft_consensus.cc:2229] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:46.516551 10240 raft_consensus.cc:2229] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:46.516672 10238 raft_consensus.cc:2258] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.516809 10240 raft_consensus.cc:2258] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.517017 10239 tablet_replica.cc:330] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: stopping tablet replica
I20260811 12:40:46.517213 10239 raft_consensus.cc:2229] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:46.517499 10239 raft_consensus.cc:2258] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.518008 10240 ts_tablet_manager.cc:1905] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.519024 10238 ts_tablet_manager.cc:1905] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.519090 10239 ts_tablet_manager.cc:1905] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.525522 10240 ts_tablet_manager.cc:1918] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:46.525810 10240 log.cc:1196] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/bf02a28d5ca34a48bb4f5ed67d1d0237
I20260811 12:40:46.526341 10240 ts_tablet_manager.cc:1939] T bf02a28d5ca34a48bb4f5ed67d1d0237 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting consensus metadata
I20260811 12:40:46.526540 10238 ts_tablet_manager.cc:1918] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:46.526788 10238 log.cc:1196] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/bf02a28d5ca34a48bb4f5ed67d1d0237
I20260811 12:40:46.527499 10238 ts_tablet_manager.cc:1939] T bf02a28d5ca34a48bb4f5ed67d1d0237 P 63f3fde6a711468da34c2297a794d97b: Deleting consensus metadata
I20260811 12:40:46.527959 9578 catalog_manager.cc:4841] TS fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675): tablet bf02a28d5ca34a48bb4f5ed67d1d0237 (table test-table [id=d5605aaa57a944a8af0ca80cdfb9c61a]) successfully deleted
I20260811 12:40:46.527860 10239 ts_tablet_manager.cc:1918] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:40:46.528921 10239 log.cc:1196] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/bf02a28d5ca34a48bb4f5ed67d1d0237
I20260811 12:40:46.529325 9579 catalog_manager.cc:4841] TS 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887): tablet bf02a28d5ca34a48bb4f5ed67d1d0237 (table test-table [id=d5605aaa57a944a8af0ca80cdfb9c61a]) successfully deleted
I20260811 12:40:46.529444 10239 ts_tablet_manager.cc:1939] T bf02a28d5ca34a48bb4f5ed67d1d0237 P cf9b2e8b0931489c9940c0516adfcc60: Deleting consensus metadata
I20260811 12:40:46.529737 9594 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58702:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 12:40:46.530567 9580 catalog_manager.cc:4841] TS cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269): tablet bf02a28d5ca34a48bb4f5ed67d1d0237 (table test-table [id=d5605aaa57a944a8af0ca80cdfb9c61a]) successfully deleted
W20260811 12:40:46.530754 9594 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:40:46.538555 9748 tablet_service.cc:1467] Processing CreateTablet for tablet 08c7db8e893148a7a6c00390c90012c6 (DEFAULT_TABLE table=test-table [id=09048c4e28ae4a0a9aa7673ce7ef9b04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:46.539070 9748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c7db8e893148a7a6c00390c90012c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:46.539050 10061 tablet_service.cc:1467] Processing CreateTablet for tablet 08c7db8e893148a7a6c00390c90012c6 (DEFAULT_TABLE table=test-table [id=09048c4e28ae4a0a9aa7673ce7ef9b04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:46.539502 10061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c7db8e893148a7a6c00390c90012c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:46.543860 10169 tablet_bootstrap.cc:492] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Bootstrap starting.
I20260811 12:40:46.545396 10169 tablet_bootstrap.cc:654] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:46.546674 10167 tablet_bootstrap.cc:492] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Bootstrap starting.
I20260811 12:40:46.547076 9903 tablet_service.cc:1467] Processing CreateTablet for tablet 08c7db8e893148a7a6c00390c90012c6 (DEFAULT_TABLE table=test-table [id=09048c4e28ae4a0a9aa7673ce7ef9b04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:40:46.547354 10169 tablet_bootstrap.cc:492] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: No bootstrap required, opened a new log
I20260811 12:40:46.547554 10169 ts_tablet_manager.cc:1397] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 12:40:46.547588 9903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c7db8e893148a7a6c00390c90012c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:46.548283 10169 raft_consensus.cc:348] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.548571 10169 raft_consensus.cc:374] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:46.548656 10169 raft_consensus.cc:729] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3fde6a711468da34c2297a794d97b, State: Initialized, Role: FOLLOWER
I20260811 12:40:46.548983 10169 consensus_queue.cc:260] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.549526 10169 ts_tablet_manager.cc:1428] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 12:40:46.551676 10167 tablet_bootstrap.cc:654] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:46.554874 10168 tablet_bootstrap.cc:492] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Bootstrap starting.
I20260811 12:40:46.556464 10167 tablet_bootstrap.cc:492] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: No bootstrap required, opened a new log
I20260811 12:40:46.556800 10168 tablet_bootstrap.cc:654] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:46.557358 10167 ts_tablet_manager.cc:1397] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260811 12:40:46.558271 10167 raft_consensus.cc:348] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.558526 10167 raft_consensus.cc:374] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:46.558626 10167 raft_consensus.cc:729] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc6b840bcf44919bf11d5f91088b8e4, State: Initialized, Role: FOLLOWER
I20260811 12:40:46.558902 10167 consensus_queue.cc:260] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.559376 10168 tablet_bootstrap.cc:492] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: No bootstrap required, opened a new log
I20260811 12:40:46.559561 10168 ts_tablet_manager.cc:1397] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 12:40:46.559612 10167 ts_tablet_manager.cc:1428] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 12:40:46.560469 10168 raft_consensus.cc:348] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.560791 10168 raft_consensus.cc:374] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:46.560892 10168 raft_consensus.cc:729] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Initialized, Role: FOLLOWER
I20260811 12:40:46.561188 10168 consensus_queue.cc:260] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.561725 10168 ts_tablet_manager.cc:1428] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 12:40:46.586138 10175 raft_consensus.cc:482] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:40:46.586391 10175 raft_consensus.cc:504] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.587127 10175 leader_election.cc:288] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:46.587638 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c7db8e893148a7a6c00390c90012c6" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b" is_pre_election: true
I20260811 12:40:46.587805 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c7db8e893148a7a6c00390c90012c6" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" is_pre_election: true
I20260811 12:40:46.587919 9779 raft_consensus.cc:2454] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:46.588057 10083 raft_consensus.cc:2454] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 0.
I20260811 12:40:46.588419 9851 leader_election.cc:302] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3fde6a711468da34c2297a794d97b, cf9b2e8b0931489c9940c0516adfcc60; no voters:
I20260811 12:40:46.588865 10175 raft_consensus.cc:2781] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:40:46.588976 10175 raft_consensus.cc:482] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:40:46.589134 10175 raft_consensus.cc:3037] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:46.591424 10175 raft_consensus.cc:504] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.592088 10175 leader_election.cc:288] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Requested vote from peers 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887), fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675)
I20260811 12:40:46.592543 9779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c7db8e893148a7a6c00390c90012c6" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3fde6a711468da34c2297a794d97b"
I20260811 12:40:46.592644 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c7db8e893148a7a6c00390c90012c6" candidate_uuid: "cf9b2e8b0931489c9940c0516adfcc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6b840bcf44919bf11d5f91088b8e4"
I20260811 12:40:46.592809 9779 raft_consensus.cc:3037] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:46.592909 10083 raft_consensus.cc:3037] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:46.595296 10083 raft_consensus.cc:2454] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:46.595788 9850 leader_election.cc:302] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf9b2e8b0931489c9940c0516adfcc60, fdc6b840bcf44919bf11d5f91088b8e4; no voters:
I20260811 12:40:46.596045 9779 raft_consensus.cc:2454] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf9b2e8b0931489c9940c0516adfcc60 in term 1.
I20260811 12:40:46.596174 10175 raft_consensus.cc:2781] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:46.596359 10175 raft_consensus.cc:686] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Becoming Leader. State: Replica: cf9b2e8b0931489c9940c0516adfcc60, State: Running, Role: LEADER
I20260811 12:40:46.596680 10175 consensus_queue.cc:237] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } }
I20260811 12:40:46.599761 9594 catalog_manager.cc:5495] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "cf9b2e8b0931489c9940c0516adfcc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf9b2e8b0931489c9940c0516adfcc60" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260811 12:40:46.629550 10083 raft_consensus.cc:1261] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:46.629611 9779 raft_consensus.cc:1261] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Refusing update from remote peer cf9b2e8b0931489c9940c0516adfcc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:40:46.630254 10175 consensus_queue.cc:1035] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc6b840bcf44919bf11d5f91088b8e4" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:46.630586 10228 consensus_queue.cc:1035] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3fde6a711468da34c2297a794d97b" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:40:46.686484 9595 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:46.686733 9595 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:40:46.689857 9595 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cd298e6d3b44a59b37cfe8ee32992d2: Sending DeleteTablet for 3 replicas of tablet 08c7db8e893148a7a6c00390c90012c6
I20260811 12:40:46.690761 9748 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c7db8e893148a7a6c00390c90012c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53454
I20260811 12:40:46.690860 9903 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c7db8e893148a7a6c00390c90012c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53060
I20260811 12:40:46.691195 10239 tablet_replica.cc:330] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: stopping tablet replica
I20260811 12:40:46.691196 10061 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c7db8e893148a7a6c00390c90012c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:40:46 UTC) from {username='oryx', principal='oryx/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:37288
I20260811 12:40:46.691429 10239 raft_consensus.cc:2229] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:40:46.691545 10240 tablet_replica.cc:330] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: stopping tablet replica
I20260811 12:40:46.691574 10238 tablet_replica.cc:330] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: stopping tablet replica
I20260811 12:40:46.691715 10240 raft_consensus.cc:2229] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:46.691767 10238 raft_consensus.cc:2229] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:40:46.691833 10239 raft_consensus.cc:2258] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.691927 10240 raft_consensus.cc:2258] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.691995 10238 raft_consensus.cc:2258] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:40:46.693359 10238 ts_tablet_manager.cc:1905] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.693846 10240 ts_tablet_manager.cc:1905] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.698544 10238 ts_tablet_manager.cc:1918] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:40:46.698714 10238 log.cc:1196] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/08c7db8e893148a7a6c00390c90012c6
I20260811 12:40:46.699214 10238 ts_tablet_manager.cc:1939] T 08c7db8e893148a7a6c00390c90012c6 P 63f3fde6a711468da34c2297a794d97b: Deleting consensus metadata
I20260811 12:40:46.699268 10239 ts_tablet_manager.cc:1905] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:40:46.699671 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 9676
I20260811 12:40:46.701664 9579 catalog_manager.cc:4841] TS 63f3fde6a711468da34c2297a794d97b (127.0.186.65:37887): tablet 08c7db8e893148a7a6c00390c90012c6 (table test-table [id=09048c4e28ae4a0a9aa7673ce7ef9b04]) successfully deleted
I20260811 12:40:46.703550 10240 ts_tablet_manager.cc:1918] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:40:46.703716 10240 log.cc:1196] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/08c7db8e893148a7a6c00390c90012c6
I20260811 12:40:46.704114 10240 ts_tablet_manager.cc:1939] T 08c7db8e893148a7a6c00390c90012c6 P fdc6b840bcf44919bf11d5f91088b8e4: Deleting consensus metadata
I20260811 12:40:46.705295 9578 catalog_manager.cc:4841] TS fdc6b840bcf44919bf11d5f91088b8e4 (127.0.186.67:46675): tablet 08c7db8e893148a7a6c00390c90012c6 (table test-table [id=09048c4e28ae4a0a9aa7673ce7ef9b04]) successfully deleted
I20260811 12:40:46.708104 10239 ts_tablet_manager.cc:1918] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 12:40:46.708302 10239 log.cc:1196] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/08c7db8e893148a7a6c00390c90012c6
I20260811 12:40:46.708873 10239 ts_tablet_manager.cc:1939] T 08c7db8e893148a7a6c00390c90012c6 P cf9b2e8b0931489c9940c0516adfcc60: Deleting consensus metadata
I20260811 12:40:46.710235 9580 catalog_manager.cc:4841] TS cf9b2e8b0931489c9940c0516adfcc60 (127.0.186.66:36269): tablet 08c7db8e893148a7a6c00390c90012c6 (table test-table [id=09048c4e28ae4a0a9aa7673ce7ef9b04]) successfully deleted
Aug 11 12:40:46 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.65@KRBTEST.COM
I20260811 12:40:46.724771 10271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:46.701250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53476 (local address 127.0.186.65:37887)
0811 12:40:46.708834 (+ 7584us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:46.708838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:46.708858 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:40:46.708923 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:46.708926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:46.709052 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:46.709195 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:46.710719 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.711500 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.712702 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.713191 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.713335 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.718141 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:46.718159 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:46.718175 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:46.718220 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:46.721684 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:46.722405 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:46.722413 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:46.722415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:46.722586 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:46.722973 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:46.722979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:46.722982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:46.723425 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:46.723731 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:46.724109 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 12:40:46.724355 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7410,"thread_start_us":7265,"threads_started":1}
I20260811 12:40:46.725476 9822 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:46.858567 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 9676
I20260811 12:40:46.889884 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 9832
Aug 11 12:40:46 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.66@KRBTEST.COM
I20260811 12:40:46.907907 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:46.890724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53088 (local address 127.0.186.66:36269)
0811 12:40:46.890914 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:46.890919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:46.890940 (+ 21us) server_negotiation.cc:407] Connection header received
0811 12:40:46.891121 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:46.891127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:46.891210 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:46.891326 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:46.892595 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.893789 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.895353 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:46.896053 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:46.896186 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:46.900809 (+ 4623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:46.900826 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:46.900845 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:46.900915 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:46.904966 (+ 4051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:46.905757 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:46.905766 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:46.905770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:46.905961 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:46.906340 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:46.906344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:46.906347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:46.906821 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:46.907153 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:46.907416 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 12:40:46.907609 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:40:46.908818 9981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:47.080111 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 9832
W20260811 12:40:47.114500 10009 connection.cc:535] server connection from 127.0.186.66:60131 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 12:40:47.114907 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 9990
Aug 11 12:40:47 dist-test-slave-qg60 krb5kdc[9546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.186.67@KRBTEST.COM
I20260811 12:40:47.139386 10275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:47.115753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.0.186.67:46675)
0811 12:40:47.116303 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:47.116307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:47.116323 (+ 16us) server_negotiation.cc:407] Connection header received
0811 12:40:47.116381 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:47.116385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:47.116444 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:47.116577 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:47.118012 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:47.118754 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:47.120066 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:47.120478 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:47.120610 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:47.132296 (+ 11686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:47.132325 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:47.132344 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:47.132405 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:47.136085 (+ 3680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:47.137101 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:47.137111 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:47.137114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:47.137274 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:47.137657 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:47.137661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:47.137663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:47.138151 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:47.138422 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:47.138707 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 12:40:47.138910 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":269,"threads_started":1}
I20260811 12:40:47.140230 10131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:47.240797 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 9990
I20260811 12:40:47.264940 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 9559
I20260811 12:40:47.266276 9641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:47.388695 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 9559
2026-08-11T12:40:47Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7323 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:47 dist-test-slave-qg60 krb5kdc[10283](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:47 dist-test-slave-qg60 krb5kdc[10283](info): set up 2 sockets
Aug 11 12:40:47 dist-test-slave-qg60 krb5kdc[10283](info): commencing operation
krb5kdc: starting...
W20260811 12:40:48.614647 745 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:48 dist-test-slave-qg60 krb5kdc[10283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:48.937976 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42623
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:42623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:49.296550 10299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:49.296979 10299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:49.297154 10299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:49.305238 10299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:49.305369 10299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:49.305490 10299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:49.305588 10299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:49.305678 10299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:49.316426 10299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:42623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:49.317866 10299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:49.319320 10299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:49.332091 10305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:49.332091 10308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:49.332167 10306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:49.333216 10299 server_base.cc:1034] running on GCE node
I20260811 12:40:49.334095 10299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:49.335825 10299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:49.337235 10299 hybrid_clock.cc:648] HybridClock initialized: now 1786452049337187 us; error 35 us; skew 500 ppm
I20260811 12:40:49.337637 10299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T12:40:49Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2021 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:40:49 dist-test-slave-qg60 krb5kdc[10317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:40:49 dist-test-slave-qg60 krb5kdc[10317](info): set up 2 sockets
Aug 11 12:40:49 dist-test-slave-qg60 krb5kdc[10317](info): commencing operation
krb5kdc: starting...
W20260811 12:40:50.726810 745 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:40:50 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:40:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:40:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:40:51.046516 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:32799
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:32799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:51.426627 10334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:51.427091 10334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:51.427253 10334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:51.435482 10334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:51.435604 10334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:51.435730 10334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:51.435823 10334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:51.435912 10334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:51.447201 10334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:32799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:32799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:51.448791 10334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:51.450343 10334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:51.464246 10340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:51.464136 10344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:51.464212 10341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:51.465581 10334 server_base.cc:1034] running on GCE node
I20260811 12:40:51.466445 10334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:51.467990 10334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:51.469269 10334 hybrid_clock.cc:648] HybridClock initialized: now 1786452051469205 us; error 46 us; skew 500 ppm
I20260811 12:40:51.469696 10334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:51 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452051, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:51.473266 10334 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:51.475600 10334 webserver.cc:460] Webserver started at http://127.0.186.126:40849/ using document root <none> and password file <none>
I20260811 12:40:51.476768 10334 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:51.476941 10334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:51.477433 10334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:51.482452 10334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b"
format_stamp: "Formatted at 2026-08-11 12:40:51 on dist-test-slave-qg60"
server_key: "39dfe78dee3622a4dd7b6ed0581d0971"
server_key_iv: "db74148c86c432ebe01a7476f495e72e"
server_key_version: "encryptionkey@0"
I20260811 12:40:51.483536 10334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b"
format_stamp: "Formatted at 2026-08-11 12:40:51 on dist-test-slave-qg60"
server_key: "39dfe78dee3622a4dd7b6ed0581d0971"
server_key_iv: "db74148c86c432ebe01a7476f495e72e"
server_key_version: "encryptionkey@0"
I20260811 12:40:51.489784 10334 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 12:40:51.493782 10353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:51.495380 10334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:51.495600 10334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b"
format_stamp: "Formatted at 2026-08-11 12:40:51 on dist-test-slave-qg60"
server_key: "39dfe78dee3622a4dd7b6ed0581d0971"
server_key_iv: "db74148c86c432ebe01a7476f495e72e"
server_key_version: "encryptionkey@0"
I20260811 12:40:51.495846 10334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:51.515623 10334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:51.520529 10334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:51.520941 10334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:51.542289 10334 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:32799
I20260811 12:40:51.542311 10414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:32799 every 8 connection(s)
I20260811 12:40:51.543778 10334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:51.547765 10415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:40:51.549204 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 10334
I20260811 12:40:51.549443 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:40:51.550153 745 external_mini_cluster.cc:1428] Setting key 13f5cda7c41c088ef75144fa7237235b
I20260811 12:40:51.562590 10415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Bootstrap starting.
Aug 11 12:40:51 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:51.566778 10415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Neither blocks nor log segments found. Creating new log.
I20260811 12:40:51.568271 10415 log.cc:824] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:51.572055 10415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: No bootstrap required, opened a new log
I20260811 12:40:51.576593 10418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:51.552249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44218 (local address 127.0.186.126:32799)
0811 12:40:51.553136 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:51.553147 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:51.553194 (+ 47us) server_negotiation.cc:407] Connection header received
0811 12:40:51.554846 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:51.554879 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:51.555284 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:51.555625 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:51.557715 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:51.559152 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:51.561025 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:51.561757 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:51.561889 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:51.566906 (+ 5017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:51.566918 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:51.566938 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:51.566993 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:51.571293 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:51.572071 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:51.572082 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:51.572090 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:51.572294 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:51.572903 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:51.572910 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:51.572915 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:51.573675 (+ 760us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:51.573981 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:51.574465 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 12:40:51.574942 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":426,"threads_started":1}
I20260811 12:40:51.582346 10415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:51.582755 10415 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:40:51.582880 10415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a6fc9d5ff94c9ab9bc798d1935f29b, State: Initialized, Role: FOLLOWER
I20260811 12:40:51.583498 10415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:51.583765 10415 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:51.583922 10415 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:51.584102 10415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:40:51.586469 10415 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:51.586990 10415 leader_election.cc:302] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44a6fc9d5ff94c9ab9bc798d1935f29b; no voters:
I20260811 12:40:51.587628 10415 leader_election.cc:288] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:40:51.587765 10420 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:40:51.588552 10420 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 LEADER]: Becoming Leader. State: Replica: 44a6fc9d5ff94c9ab9bc798d1935f29b, State: Running, Role: LEADER
I20260811 12:40:51.589169 10420 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:51.589864 10415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:51.592478 10422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } } }
I20260811 12:40:51.592505 10423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a6fc9d5ff94c9ab9bc798d1935f29b. Latest consensus state: current_term: 1 leader_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } } }
I20260811 12:40:51.592962 10423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:51.592962 10422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:51.595511 10428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:51.601248 10428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:51.609862 10428 catalog_manager.cc:1347] Generated new cluster ID: d32698f48e414c6fbd416ee7dcccc1aa
I20260811 12:40:51.609987 10428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:51.627444 10428 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:40:51.628939 10428 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:51.641150 10428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Generated new TSK 0
I20260811 12:40:51.642089 10428 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:40:51.728911 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:32799
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:52.090745 10443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:52.091060 10443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:52.091219 10443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:52.098819 10443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:52.098966 10443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:52.099223 10443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:52.109993 10443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:32799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:52.111461 10443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:52.112977 10443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:52.127045 10448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:52.127188 10451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:52.127219 10449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:52.128450 10443 server_base.cc:1034] running on GCE node
I20260811 12:40:52.129197 10443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:52.130215 10443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:52.131474 10443 hybrid_clock.cc:648] HybridClock initialized: now 1786452052131398 us; error 50 us; skew 500 ppm
I20260811 12:40:52.131824 10443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:52 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452052, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:52.141628 10443 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:40:52.143322 10443 webserver.cc:460] Webserver started at http://127.0.186.65:33029/ using document root <none> and password file <none>
I20260811 12:40:52.144104 10443 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:52.144263 10443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:52.144600 10443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:52.147768 10443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "56d55429777b49459ea7b762acf1934e"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "bfdbbd745f9217f297a069ea275884ce"
server_key_iv: "8b01a72d7912a9bb87dd5358fe459ff7"
server_key_version: "encryptionkey@0"
I20260811 12:40:52.148627 10443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "56d55429777b49459ea7b762acf1934e"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "bfdbbd745f9217f297a069ea275884ce"
server_key_iv: "8b01a72d7912a9bb87dd5358fe459ff7"
server_key_version: "encryptionkey@0"
I20260811 12:40:52.154300 10443 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 12:40:52.158263 10459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:52.159737 10443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:40:52.159952 10443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "56d55429777b49459ea7b762acf1934e"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "bfdbbd745f9217f297a069ea275884ce"
server_key_iv: "8b01a72d7912a9bb87dd5358fe459ff7"
server_key_version: "encryptionkey@0"
I20260811 12:40:52.160187 10443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:52.175762 10443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:52.180549 10443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:52.180941 10443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:52.182036 10443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:52.183543 10443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:52.183653 10443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:52.183811 10443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:52.183899 10443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:52.221230 10443 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:44987
I20260811 12:40:52.221283 10596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:44987 every 8 connection(s)
I20260811 12:40:52.222613 10443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:52.225812 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 10443
I20260811 12:40:52.226118 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:40:52.227075 745 external_mini_cluster.cc:1428] Setting key 95f1975e75b83dd8bd8a43c00d72aee4
Aug 11 12:40:52 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452052, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:52.246977 10599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:52.225520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:49891 (local address 127.0.186.126:32799)
0811 12:40:52.226052 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:52.226058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:52.227793 (+ 1735us) server_negotiation.cc:407] Connection header received
0811 12:40:52.229614 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:52.229618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:52.229698 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:52.229791 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:52.232184 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.233093 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.235726 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.236147 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.236261 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:52.240970 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:52.240976 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:52.240979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:52.241023 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:52.243728 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:52.244521 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:52.244530 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:52.244533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:52.244666 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:52.245156 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:52.245161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:52.245165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:52.245450 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:52.245615 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:52.246354 (+ 739us) server_negotiation.cc:299] Negotiation successful
0811 12:40:52.246606 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":251,"threads_started":1}
I20260811 12:40:52.248026 10600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:52.226068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:49891)
0811 12:40:52.227054 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:52.227114 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:52.229231 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:52.230128 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:52.230142 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:52.231021 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:52.231964 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:52.231995 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.233274 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.233282 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:52.235521 (+ 2239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:52.235540 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.236421 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.236431 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:52.236810 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:52.237660 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:52.237697 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:52.240655 (+ 2958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:52.243901 (+ 3246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:52.243911 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:52.243931 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:52.244388 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:52.244807 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:52.244812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:52.244816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:52.245035 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:52.245589 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:52.245598 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:52.245961 (+ 363us) client_negotiation.cc:769] Sending connection context
0811 12:40:52.246258 (+ 297us) client_negotiation.cc:240] Negotiation successful
0811 12:40:52.246837 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":349,"threads_started":1}
I20260811 12:40:52.249783 10597 heartbeater.cc:347] Connected to a master server at 127.0.186.126:32799
I20260811 12:40:52.250113 10597 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:52.250876 10597 heartbeater.cc:511] Master 127.0.186.126:32799 requested a full tablet report, sending...
I20260811 12:40:52.253491 10371 ts_manager.cc:194] Registered new tserver with Master: 56d55429777b49459ea7b762acf1934e (127.0.186.65:44987)
I20260811 12:40:52.256054 10371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:49891
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:40:52.301645 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:32799
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:52.658492 10606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:52.658790 10606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:52.658963 10606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:52.667601 10606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:52.667727 10606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:52.667932 10606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:52.678238 10606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:32799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:52.679634 10606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:52.681092 10606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:52.695600 10611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:52.695544 10612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:52.695636 10614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:52.696704 10606 server_base.cc:1034] running on GCE node
I20260811 12:40:52.697383 10606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:52.698333 10606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:52.699532 10606 hybrid_clock.cc:648] HybridClock initialized: now 1786452052699468 us; error 56 us; skew 500 ppm
I20260811 12:40:52.699865 10606 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:52 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452052, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:52.703284 10606 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:40:52.705067 10606 webserver.cc:460] Webserver started at http://127.0.186.66:33017/ using document root <none> and password file <none>
I20260811 12:40:52.705802 10606 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:52.705955 10606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:52.706301 10606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:52.709463 10606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "f484e54254f2457e9d5e9559b10e559f"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "5990367cdf083530d43cc0a0d6010d51"
server_key_iv: "dce1194a5de30bbdbce2408efbb1251e"
server_key_version: "encryptionkey@0"
I20260811 12:40:52.710314 10606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "f484e54254f2457e9d5e9559b10e559f"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "5990367cdf083530d43cc0a0d6010d51"
server_key_iv: "dce1194a5de30bbdbce2408efbb1251e"
server_key_version: "encryptionkey@0"
I20260811 12:40:52.715751 10606 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 12:40:52.719377 10621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:52.720692 10606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:40:52.720897 10606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "f484e54254f2457e9d5e9559b10e559f"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "5990367cdf083530d43cc0a0d6010d51"
server_key_iv: "dce1194a5de30bbdbce2408efbb1251e"
server_key_version: "encryptionkey@0"
I20260811 12:40:52.721145 10606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:52.747066 10606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:52.752305 10606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:52.752652 10606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:52.753777 10606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:52.755292 10606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:52.755412 10606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:52.755573 10606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:52.755651 10606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:52.793475 10606 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:34771
I20260811 12:40:52.793592 10753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:34771 every 8 connection(s)
I20260811 12:40:52.794871 10606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:52.804808 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 10606
I20260811 12:40:52.805018 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:40:52.805660 745 external_mini_cluster.cc:1428] Setting key 73ba1c56f5221f1afe16ea8afc2b277b
Aug 11 12:40:52 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452052, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:52.818610 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:52.798024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:39951 (local address 127.0.186.126:32799)
0811 12:40:52.798565 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:52.798572 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:52.799572 (+ 1000us) server_negotiation.cc:407] Connection header received
0811 12:40:52.801586 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:52.801590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:52.801673 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:52.801781 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:52.803466 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.804291 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.806851 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.807548 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.807701 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:52.812551 (+ 4850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:52.812557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:52.812560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:52.812595 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:52.815308 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:52.816115 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:52.816119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:52.816122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:52.816250 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:52.816709 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:52.816714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:52.816716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:52.817060 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:52.817230 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:52.817952 (+ 722us) server_negotiation.cc:299] Negotiation successful
0811 12:40:52.818186 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":257,"threads_started":1}
I20260811 12:40:52.819612 10757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:52.798560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:39951)
0811 12:40:52.799377 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:52.799473 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:52.801307 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:52.802066 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:52.802075 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:52.802671 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:52.803278 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:52.803296 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.804492 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.804501 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:52.806648 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:52.806666 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:52.807865 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:52.807881 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:52.808207 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:52.809172 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:52.809213 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:52.812292 (+ 3079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:52.815484 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:52.815493 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:52.815511 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:52.815962 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:52.816368 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:52.816373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:52.816377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:52.816577 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:52.817202 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:52.817210 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:52.817569 (+ 359us) client_negotiation.cc:769] Sending connection context
0811 12:40:52.817842 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 12:40:52.818422 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":322,"threads_started":1}
I20260811 12:40:52.821244 10754 heartbeater.cc:347] Connected to a master server at 127.0.186.126:32799
I20260811 12:40:52.821573 10754 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:52.822368 10754 heartbeater.cc:511] Master 127.0.186.126:32799 requested a full tablet report, sending...
I20260811 12:40:52.823921 10371 ts_manager.cc:194] Registered new tserver with Master: f484e54254f2457e9d5e9559b10e559f (127.0.186.66:34771)
I20260811 12:40:52.824852 10371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:39951
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:40:52.877293 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:32799
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:53.238675 10760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:53.238978 10760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:53.239076 10760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:53.246542 10760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:53.246667 10760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:53.246781 10760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:53.256946 10760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:32799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:53.258329 10760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:53.259680 10760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 12:40:53.259786 10597 heartbeater.cc:503] Master 127.0.186.126:32799 was elected leader, sending a full tablet report...
W20260811 12:40:53.274303 10767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:53.274394 10770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:53.274372 10768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:53.282842 10760 server_base.cc:1034] running on GCE node
I20260811 12:40:53.283617 10760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:53.284682 10760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:53.286008 10760 hybrid_clock.cc:648] HybridClock initialized: now 1786452053285933 us; error 61 us; skew 500 ppm
I20260811 12:40:53.286389 10760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:53 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452053, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:53.290158 10760 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:40:53.291975 10760 webserver.cc:460] Webserver started at http://127.0.186.67:38701/ using document root <none> and password file <none>
I20260811 12:40:53.292836 10760 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:53.292999 10760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:53.293349 10760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:40:53.296535 10760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "31cb3dba23a445928ad80264af08d5ee"
format_stamp: "Formatted at 2026-08-11 12:40:53 on dist-test-slave-qg60"
server_key: "5d7c2697af538f894808812aacd45628"
server_key_iv: "025ac0a93467d6b9574c110a1a66b85d"
server_key_version: "encryptionkey@0"
I20260811 12:40:53.297516 10760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "31cb3dba23a445928ad80264af08d5ee"
format_stamp: "Formatted at 2026-08-11 12:40:53 on dist-test-slave-qg60"
server_key: "5d7c2697af538f894808812aacd45628"
server_key_iv: "025ac0a93467d6b9574c110a1a66b85d"
server_key_version: "encryptionkey@0"
I20260811 12:40:53.304031 10760 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260811 12:40:53.308176 10779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:53.309923 10760 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:40:53.310163 10760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "31cb3dba23a445928ad80264af08d5ee"
format_stamp: "Formatted at 2026-08-11 12:40:53 on dist-test-slave-qg60"
server_key: "5d7c2697af538f894808812aacd45628"
server_key_iv: "025ac0a93467d6b9574c110a1a66b85d"
server_key_version: "encryptionkey@0"
I20260811 12:40:53.310422 10760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:53.330651 10760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:53.335278 10760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:53.335602 10760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:53.336825 10760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:53.338307 10760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:53.338418 10760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:53.338582 10760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:53.338666 10760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:53.376559 10760 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:36325
I20260811 12:40:53.376613 10907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:36325 every 8 connection(s)
I20260811 12:40:53.378087 10760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:53.380492 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 10760
I20260811 12:40:53.380681 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:40:53.381520 745 external_mini_cluster.cc:1428] Setting key 77560cbd8579a5a36222ab0086fe7c02
Aug 11 12:40:53 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452053, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:40:53.401693 10910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:53.381124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:54615 (local address 127.0.186.126:32799)
0811 12:40:53.381767 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:53.381773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:53.382838 (+ 1065us) server_negotiation.cc:407] Connection header received
0811 12:40:53.385010 (+ 2172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:53.385015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:53.385106 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:53.385207 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:53.386818 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.387696 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.389443 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.389888 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.390062 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:53.394170 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:53.394175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:53.394179 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:53.394216 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:53.398154 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.399066 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.399070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.399073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.399207 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.399726 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.399731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.399734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.400153 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:53.400287 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:53.401191 (+ 904us) server_negotiation.cc:299] Negotiation successful
0811 12:40:53.401378 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":320,"threads_started":1}
I20260811 12:40:53.402709 10912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:53.381739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:54615)
0811 12:40:53.382663 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:53.382714 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:53.384664 (+ 1950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:53.385467 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:53.385476 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:53.386025 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:53.386619 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:53.386637 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.387851 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.387855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:53.389308 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:53.389320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.390177 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.390186 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:53.390409 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:53.391203 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:53.391239 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:53.393929 (+ 2690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:40:53.398304 (+ 4375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:53.398311 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:53.398327 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:53.398845 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:53.399344 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:40:53.399348 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:40:53.399350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:40:53.399563 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:40:53.400283 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:40:53.400290 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:40:53.400652 (+ 362us) client_negotiation.cc:769] Sending connection context
0811 12:40:53.401049 (+ 397us) client_negotiation.cc:240] Negotiation successful
0811 12:40:53.401483 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":384,"threads_started":1}
I20260811 12:40:53.404327 10908 heartbeater.cc:347] Connected to a master server at 127.0.186.126:32799
I20260811 12:40:53.404850 10908 heartbeater.cc:464] Registering TS with master...
I20260811 12:40:53.405674 10908 heartbeater.cc:511] Master 127.0.186.126:32799 requested a full tablet report, sending...
I20260811 12:40:53.407385 10371 ts_manager.cc:194] Registered new tserver with Master: 31cb3dba23a445928ad80264af08d5ee (127.0.186.67:36325)
I20260811 12:40:53.408234 10371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:54615
I20260811 12:40:53.410483 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab.
Entry for principal oryx/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab.
WARNING: no policy specified for oryx/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab.
Entry for principal oryx/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab.
WARNING: no policy specified for oryx/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab.
Entry for principal oryx/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab.
I20260811 12:40:53.613847 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 10443
Aug 11 12:40:53 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:40:53.641924 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:53.615319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36814 (local address 127.0.186.65:44987)
0811 12:40:53.616148 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:53.616156 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:53.616186 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:40:53.616257 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:53.616264 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:53.616508 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:53.616681 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:53.618363 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.619591 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.621112 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.621754 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.621869 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:53.635456 (+ 13587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:53.635476 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:53.635494 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:53.635545 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:53.638884 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.639729 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.639737 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.639739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.639889 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.640310 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.640314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.640316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.640711 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:53.641051 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:53.641389 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 12:40:53.641615 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":479,"threads_started":1}
I20260811 12:40:53.643483 10592 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:53.740242 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 10443
I20260811 12:40:53.768319 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 10606
Aug 11 12:40:53 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:40:53.786531 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:53.769425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34360 (local address 127.0.186.66:34771)
0811 12:40:53.770088 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:53.770095 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:53.770123 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:40:53.770189 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:53.770195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:53.770412 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:53.770574 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:53.772011 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.773497 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.774854 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.775404 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.775504 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:53.780000 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:53.780012 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:53.780061 (+ 49us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:53.780110 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:53.783055 (+ 2945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.783812 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.783820 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.783823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.783999 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.784409 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.784415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.784419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.784994 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:53.785228 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:53.785772 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 12:40:53.786161 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":334,"threads_started":1}
I20260811 12:40:53.787919 10749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:53.879674 10754 heartbeater.cc:503] Master 127.0.186.126:32799 was elected leader, sending a full tablet report...
I20260811 12:40:53.880844 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 10606
W20260811 12:40:53.902699 10355 connection.cc:535] server connection from 127.0.186.66:39951 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 12:40:53.903126 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 10760
Aug 11 12:40:53 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:40:53.920222 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:53.904255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33990 (local address 127.0.186.67:36325)
0811 12:40:53.904770 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:53.904786 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:53.904813 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:40:53.904877 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:53.904883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:53.905109 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:53.905237 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:53.906596 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.907611 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.909032 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:53.909593 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:53.909696 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:53.914568 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:53.914581 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:53.914596 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:53.914637 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:53.917722 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.918378 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.918384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.918387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.918510 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:53.918863 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:53.918866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:53.918868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:53.919223 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:53.919463 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:53.919700 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 12:40:53.919902 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":214,"threads_started":1}
I20260811 12:40:53.922005 10903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:54.015674 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 10760
I20260811 12:40:54.038784 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 10334
I20260811 12:40:54.040388 10410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:40:54.149698 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 10334
I20260811 12:40:54.176837 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:32799
--webserver_interface=127.0.186.126
--webserver_port=40849
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:32799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:40:54.533653 10928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:54.533962 10928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:54.534058 10928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:54.541378 10928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:40:54.541499 10928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:54.541548 10928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:54.541599 10928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:40:54.541651 10928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:40:54.551856 10928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:32799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:32799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=40849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:54.553297 10928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:54.554653 10928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:54.566970 10936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:54.567054 10933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:54.567054 10934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:54.568207 10928 server_base.cc:1034] running on GCE node
I20260811 12:40:54.569123 10928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:54.570631 10928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:54.571888 10928 hybrid_clock.cc:648] HybridClock initialized: now 1786452054571830 us; error 68 us; skew 500 ppm
I20260811 12:40:54.572295 10928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:54 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452054, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:54.575683 10928 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:40:54.577409 10928 webserver.cc:460] Webserver started at http://127.0.186.126:40849/ using document root <none> and password file <none>
I20260811 12:40:54.578143 10928 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:54.578320 10928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:54.583837 10928 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 12:40:54.586876 10943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:54.588191 10928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:40:54.588390 10928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b"
format_stamp: "Formatted at 2026-08-11 12:40:51 on dist-test-slave-qg60"
server_key: "39dfe78dee3622a4dd7b6ed0581d0971"
server_key_iv: "db74148c86c432ebe01a7476f495e72e"
server_key_version: "encryptionkey@0"
I20260811 12:40:54.589532 10928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:54.607298 10928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:54.611706 10928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:54.612007 10928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:54.632165 10928 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:32799
I20260811 12:40:54.632256 11004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:32799 every 8 connection(s)
I20260811 12:40:54.633833 10928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:40:54.637914 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 10928
I20260811 12:40:54.638764 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:44987
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:32799
--webserver_port=33029
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:40:54.641311 11006 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:40:54.644696 11006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Bootstrap starting.
I20260811 12:40:54.665115 11006 log.cc:824] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Log is configured to *not* fsync() on all Append() calls
I20260811 12:40:54.674257 11006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:40:54.674808 11006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Bootstrap complete.
I20260811 12:40:54.684651 11006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:54.685652 11006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a6fc9d5ff94c9ab9bc798d1935f29b, State: Initialized, Role: FOLLOWER
I20260811 12:40:54.686306 11006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:54.686578 11006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:40:54.686709 11006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:40:54.686933 11006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 1 FOLLOWER]: Advancing to term 2
I20260811 12:40:54.690985 11006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:54.691543 11006 leader_election.cc:302] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44a6fc9d5ff94c9ab9bc798d1935f29b; no voters:
I20260811 12:40:54.692250 11006 leader_election.cc:288] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 12:40:54.692399 11014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 12:40:54.693794 11014 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [term 2 LEADER]: Becoming Leader. State: Replica: 44a6fc9d5ff94c9ab9bc798d1935f29b, State: Running, Role: LEADER
I20260811 12:40:54.694576 11014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } }
I20260811 12:40:54.694789 11006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:40:54.697327 11016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a6fc9d5ff94c9ab9bc798d1935f29b. Latest consensus state: current_term: 2 leader_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } } }
I20260811 12:40:54.697813 11016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:54.698341 11015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44a6fc9d5ff94c9ab9bc798d1935f29b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32799 } } }
I20260811 12:40:54.698715 11015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b [sys.catalog]: This master's current role is: LEADER
I20260811 12:40:54.704034 11022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:40:54.711553 11022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:40:54.713452 11022 catalog_manager.cc:1259] Loaded cluster ID: d32698f48e414c6fbd416ee7dcccc1aa
I20260811 12:40:54.713652 11022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:40:54.719493 11022 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:40:54.721680 11022 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 44a6fc9d5ff94c9ab9bc798d1935f29b: Loaded TSK: 0
I20260811 12:40:54.723701 11022 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 12:40:55.031041 11011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:55.031389 11011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:55.031570 11011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:55.039005 11011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:55.039178 11011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:55.039373 11011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:40:55.049609 11011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.65.keytab
--principal=oryx/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:44987
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=33029
--tserver_master_addrs=127.0.186.126:32799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:55.051121 11011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:55.052575 11011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:55.066785 11040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:55.066831 11042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:55.067749 11011 server_base.cc:1034] running on GCE node
W20260811 12:40:55.069042 11038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:55.069911 11011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:55.071094 11011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:55.072346 11011 hybrid_clock.cc:648] HybridClock initialized: now 1786452055072289 us; error 51 us; skew 500 ppm
I20260811 12:40:55.072707 11011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:55 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452055, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:55.076114 11011 init.cc:377] Logged in from keytab as oryx/127.0.186.65@KRBTEST.COM (short username oryx)
I20260811 12:40:55.078510 11011 webserver.cc:460] Webserver started at http://127.0.186.65:33029/ using document root <none> and password file <none>
I20260811 12:40:55.079600 11011 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:55.079823 11011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:55.088433 11011 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:40:55.092573 11049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:55.098219 11011 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260811 12:40:55.098418 11011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "56d55429777b49459ea7b762acf1934e"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "bfdbbd745f9217f297a069ea275884ce"
server_key_iv: "8b01a72d7912a9bb87dd5358fe459ff7"
server_key_version: "encryptionkey@0"
I20260811 12:40:55.099927 11011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:55.127846 11011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:55.132403 11011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:55.132692 11011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:55.133869 11011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:55.135411 11011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:55.135540 11011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:55.135681 11011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:55.135771 11011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:55.175294 11011 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:44987
I20260811 12:40:55.175346 11177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:44987 every 8 connection(s)
I20260811 12:40:55.176918 11011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:40:55.182034 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11011
I20260811 12:40:55.182842 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:34771
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:32799
--webserver_port=33017
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:40:55 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:55 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 12:40:55.618695 11184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:55.619074 11184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:55.619249 11184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:55.627027 11184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:55.627200 11184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:55.627377 11184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:40:55.637933 11184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.66.keytab
--principal=oryx/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:34771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=33017
--tserver_master_addrs=127.0.186.126:32799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:55.639437 11184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:55.640930 11184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:55.660137 11191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:55.661993 11194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:55.662439 11192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:55.662932 11184 server_base.cc:1034] running on GCE node
I20260811 12:40:55.664096 11184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:55.665918 11184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:55.667294 11184 hybrid_clock.cc:648] HybridClock initialized: now 1786452055667196 us; error 74 us; skew 500 ppm
I20260811 12:40:55.667866 11184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:55 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452055, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:55.673770 11184 init.cc:377] Logged in from keytab as oryx/127.0.186.66@KRBTEST.COM (short username oryx)
I20260811 12:40:55.676482 11184 webserver.cc:460] Webserver started at http://127.0.186.66:33017/ using document root <none> and password file <none>
I20260811 12:40:55.677919 11184 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:55.678153 11184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:55.689251 11184 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 12:40:55.694386 11202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:55.697026 11184 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260811 12:40:55.697317 11184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "f484e54254f2457e9d5e9559b10e559f"
format_stamp: "Formatted at 2026-08-11 12:40:52 on dist-test-slave-qg60"
server_key: "5990367cdf083530d43cc0a0d6010d51"
server_key_iv: "dce1194a5de30bbdbce2408efbb1251e"
server_key_version: "encryptionkey@0"
I20260811 12:40:55.699429 11184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:55.723078 11184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:55.729756 11184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:55.730111 11184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:55.731341 11184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:55.733083 11184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:55.733233 11184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:55.733413 11184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:55.733525 11184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:55.781497 11184 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:34771
I20260811 12:40:55.781597 11336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:34771 every 8 connection(s)
I20260811 12:40:55.783166 11184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:40:55.784904 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11184
I20260811 12:40:55.786010 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:36325
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:32799
--webserver_port=38701
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:40:55 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:55 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 12:40:56.198623 11344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:40:56.198978 11344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:40:56.199172 11344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:40:56.207350 11344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:40:56.207512 11344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:40:56.207731 11344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:40:56.218323 11344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/krb5kdc/oryx_127.0.186.67.keytab
--principal=oryx/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:36325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=38701
--tserver_master_addrs=127.0.186.126:32799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:40:56.219798 11344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:40:56.221254 11344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:40:56.239549 11350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:56.249344 11351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:40:56.252470 11354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:40:56.252964 11344 server_base.cc:1034] running on GCE node
I20260811 12:40:56.254522 11344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:40:56.256589 11344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:40:56.258152 11344 hybrid_clock.cc:648] HybridClock initialized: now 1786452056258041 us; error 91 us; skew 500 ppm
I20260811 12:40:56.258741 11344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452056, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:40:56.265341 11344 init.cc:377] Logged in from keytab as oryx/127.0.186.67@KRBTEST.COM (short username oryx)
I20260811 12:40:56.268551 11344 webserver.cc:460] Webserver started at http://127.0.186.67:38701/ using document root <none> and password file <none>
I20260811 12:40:56.270041 11344 fs_manager.cc:359] Metadata directory not provided
I20260811 12:40:56.270283 11344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:40:56.281674 11344 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 12:40:56.287200 11362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:56.290009 11344 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260811 12:40:56.290304 11344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "31cb3dba23a445928ad80264af08d5ee"
format_stamp: "Formatted at 2026-08-11 12:40:53 on dist-test-slave-qg60"
server_key: "5d7c2697af538f894808812aacd45628"
server_key_iv: "025ac0a93467d6b9574c110a1a66b85d"
server_key_version: "encryptionkey@0"
I20260811 12:40:56.292490 11344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:40:56.320020 11344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:40:56.328771 11344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:40:56.329289 11344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:40:56.331223 11344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:40:56.334201 11344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:40:56.334396 11344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:56.334564 11344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:40:56.334694 11344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:40:56.394812 11344 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:36325
I20260811 12:40:56.394924 11494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:36325 every 8 connection(s)
I20260811 12:40:56.398023 11344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:40:56.399896 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11344
I20260811 12:40:56.452929 11498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:56.402475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60270 (local address 127.0.186.126:32799)
0811 12:40:56.426012 (+ 23537us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:56.426023 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:56.427542 (+ 1519us) server_negotiation.cc:407] Connection header received
0811 12:40:56.427679 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:56.427689 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:56.427837 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:56.427993 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:56.432220 (+ 4227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.433741 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.436090 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.436982 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.437128 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.441458 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:40:56.441471 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:40:56.441497 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:40:56.441561 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:40:56.446392 (+ 4831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:56.447525 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:56.447535 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:56.447545 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:56.447796 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:40:56.448221 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:40:56.448226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:40:56.448230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:40:56.448921 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:40:56.449226 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0811 12:40:56.450693 (+ 1467us) server_negotiation.cc:299] Negotiation successful
0811 12:40:56.451789 (+ 1096us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23309,"thread_start_us":31355,"threads_started":1}
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 12:40:56.559016 11182 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.366s user 0.002s sys 0.015s
W20260811 12:40:56.560693 11183 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:55.180054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:52133 (local address 127.0.186.126:32799)
0811 12:40:55.180909 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:55.180925 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:55.181100 (+ 175us) server_negotiation.cc:407] Connection header received
0811 12:40:55.184137 (+ 3037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:55.184150 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:55.184523 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:55.184916 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:55.186953 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.188217 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.190979 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.191641 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.191779 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.560359 (+1368580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:52133: BlockingRecv error: recv got EOF from 127.0.186.65:52133 (error 108)
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":337,"threads_started":1}
I20260811 12:40:56.561283 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:55.180008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:52133)
0811 12:40:55.180922 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:55.180967 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:55.183558 (+ 2591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:55.185110 (+ 1552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:55.185123 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:55.185945 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:55.186738 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:55.186767 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.188410 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.188418 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:55.190801 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:55.190822 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.191903 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.191913 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:55.192244 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:55.193091 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:55.193133 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:56.560042 (+1366909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":354,"threads_started":1}
W20260811 12:40:56.562224 11178 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:32799 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.186.126:32799: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:56.573199 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:56.562950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:55745)
0811 12:40:56.563153 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:56.563173 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:56.563295 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:56.563747 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:56.563752 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:56.564194 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:56.564368 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:56.564377 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.565517 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.565522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:56.566674 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:56.566686 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.567682 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.567688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:56.567876 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.568529 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:56.568547 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:56.572899 (+ 4352us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 12:40:56.574064 11183 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:56.563307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:55745 (local address 127.0.186.126:32799)
0811 12:40:56.563474 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:56.563478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:56.563492 (+ 14us) server_negotiation.cc:407] Connection header received
0811 12:40:56.563534 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:56.563537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:56.563601 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:56.563713 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:56.564526 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.565361 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.566822 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.567454 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.567636 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.573777 (+ 6141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:55745: BlockingRecv error: recv got EOF from 127.0.186.65:55745 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:56 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:56.582993 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:56.574025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:60451)
0811 12:40:56.574399 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:56.574419 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:56.574534 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:56.574894 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:56.574900 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:56.575345 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:56.575511 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:56.575520 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.576546 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.576560 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:56.577570 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:56.577582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.578367 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.578373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:56.578568 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.579164 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:56.579181 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:56.582707 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248}
W20260811 12:40:56.583209 11183 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:56.574433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:60451 (local address 127.0.186.126:32799)
0811 12:40:56.574600 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:56.574608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:56.574625 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:40:56.574682 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:56.574686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:56.574753 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:56.574860 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:56.575659 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.576400 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.577722 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.578157 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.578304 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.582912 (+ 4608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:60451: BlockingRecv error: recv got EOF from 127.0.186.65:60451 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 12:40:56.583580 11178 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 12:40:57.231858 11342 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.414s user 0.004s sys 0.019s
W20260811 12:40:57.233330 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:55.789138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:56453 (local address 127.0.186.126:32799)
0811 12:40:55.804706 (+ 15568us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:55.804711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:55.804800 (+ 89us) server_negotiation.cc:407] Connection header received
0811 12:40:55.805644 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:55.805655 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:55.805796 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:55.805942 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:55.809419 (+ 3477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.810943 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.814578 (+ 3635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.815485 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.815713 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.233050 (+1417337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:56453: BlockingRecv error: recv got EOF from 127.0.186.66:56453 (error 108)
Metrics: {"server-negotiator.queue_time_us":15447,"thread_start_us":15243,"threads_started":1}
I20260811 12:40:57.234119 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:55.790357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:56453)
0811 12:40:55.800770 (+ 10413us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:55.800859 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:55.804797 (+ 3938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:55.806668 (+ 1871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:55.806688 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:55.807855 (+ 1167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:55.809089 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:55.809126 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.811196 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.811205 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:55.814317 (+ 3112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:55.814343 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:55.815863 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:55.815873 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:55.816364 (+ 491us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:55.817611 (+ 1247us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:55.817661 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.232835 (+1415174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":9794,"thread_start_us":14285,"threads_started":1}
W20260811 12:40:57.235265 11338 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:32799 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.186.126:32799: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 12:40:57.254890 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:57.236203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:34315 (local address 127.0.186.126:32799)
0811 12:40:57.236413 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:57.236421 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:57.236444 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:40:57.236506 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:57.236511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:57.236584 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:57.236688 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:57.237493 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.238244 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.239592 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.240049 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.240199 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.254690 (+ 14491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:34315: BlockingRecv error: recv got EOF from 127.0.186.66:34315 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 12:40:57.254981 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:57.236003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:34315)
0811 12:40:57.236212 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:57.236229 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:57.236374 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:57.236722 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:57.236769 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:57.237151 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:57.237329 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.237338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.238422 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.238426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.239387 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.239407 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.240238 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.240245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.240439 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.248073 (+ 7634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:57.248118 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.254513 (+ 6395us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":67}
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:57.267417 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:57.255991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:59857)
0811 12:40:57.256247 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:57.256271 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:57.256396 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:57.257377 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:57.257381 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:57.257744 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:57.257922 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.257931 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.259965 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.259971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.261169 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.261182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.262564 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.262569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.262750 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.263476 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:57.263501 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.267129 (+ 3628us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108}
W20260811 12:40:57.268414 11338 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 12:40:57.269239 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:57.256677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:59857 (local address 127.0.186.126:32799)
0811 12:40:57.256940 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:57.256949 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:57.256976 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:40:57.257073 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:57.257082 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:57.257190 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:57.257337 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:57.258109 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.259767 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.261334 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.262355 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.262535 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.268670 (+ 6135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:59857: BlockingRecv error: recv got EOF from 127.0.186.66:59857 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:57.596192 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:57.584288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:53007)
0811 12:40:57.585041 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:57.585060 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:57.585191 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:57.585612 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:57.585616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:57.586150 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:57.586317 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.586327 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.587773 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.587777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.589086 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.589100 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.590137 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.590146 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.590341 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.591213 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:57.591260 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.595857 (+ 4597us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":451,"threads_started":1}
W20260811 12:40:57.596485 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:57.584426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:53007 (local address 127.0.186.126:32799)
0811 12:40:57.584635 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:57.584641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:57.585144 (+ 503us) server_negotiation.cc:407] Connection header received
0811 12:40:57.585306 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:57.585311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:57.585414 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:57.585522 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:57.586485 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.587615 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.589247 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.589904 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.590083 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.596136 (+ 6053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:53007: BlockingRecv error: recv got EOF from 127.0.186.65:53007 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 12:40:57.668954 11500 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.203s user 0.004s sys 0.026s
W20260811 12:40:57.670254 11501 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:56.424839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:57703 (local address 127.0.186.126:32799)
0811 12:40:56.446059 (+ 21220us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:56.446074 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:56.451874 (+ 5800us) server_negotiation.cc:407] Connection header received
0811 12:40:56.452006 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:56.452014 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:56.452168 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:56.452316 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:56.459142 (+ 6826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.461061 (+ 1919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.463560 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.464578 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.464784 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.669974 (+1205190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:57703: BlockingRecv error: recv got EOF from 127.0.186.67:57703 (error 108)
Metrics: {"server-negotiator.queue_time_us":20980,"thread_start_us":21244,"threads_started":1}
I20260811 12:40:57.670816 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:56.423724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:57703)
0811 12:40:56.447141 (+ 23417us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:56.447227 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:56.451151 (+ 3924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:56.456208 (+ 5057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:56.456821 (+ 613us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:56.457883 (+ 1062us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:56.458889 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:56.458917 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.461271 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.461279 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:56.463368 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:56.463386 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:56.464893 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:56.464900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:56.465189 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:56.466154 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:56.466183 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.669745 (+1203562us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":22873,"thread_start_us":28710,"threads_started":1}
W20260811 12:40:57.671900 11495 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:32799 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.186.126:32799: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:57.682225 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:57.672681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:44321)
0811 12:40:57.672936 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:57.672954 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:57.673097 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:57.673382 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:57.673385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:57.673726 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:57.673892 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.673900 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.674944 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.674948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.675927 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.675939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.676776 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.676785 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.677112 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.677889 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:57.677913 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.681948 (+ 4035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131}
W20260811 12:40:57.682376 11501 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:57.672803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44321 (local address 127.0.186.126:32799)
0811 12:40:57.673122 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:57.673127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:57.673145 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:40:57.673196 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:57.673199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:57.673258 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:57.673340 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:57.674066 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.674815 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.676068 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.676522 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.676619 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.682173 (+ 5554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:44321: BlockingRecv error: recv got EOF from 127.0.186.67:44321 (error 108)
Metrics: {"server-negotiator.queue_time_us":160}
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:57 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:57.691870 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:57.682979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:44303)
0811 12:40:57.683211 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:57.683232 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:57.683339 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:57.683734 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:57.683741 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:57.684076 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:57.684241 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.684250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.685361 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.685367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.686358 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:57.686370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.687118 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.687124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:57.687339 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.687891 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:57.687908 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:57.691667 (+ 3759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96}
W20260811 12:40:57.692176 11501 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:57.683070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44303 (local address 127.0.186.126:32799)
0811 12:40:57.683251 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:57.683259 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:57.683278 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:40:57.683468 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:57.683473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:57.683585 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:57.683694 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:57.684383 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.685218 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.686538 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:57.686953 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:57.687102 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:57.691850 (+ 4748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:44303: BlockingRecv error: recv got EOF from 127.0.186.67:44303 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 12:40:57.692389 11495 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 12:40:58 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:58 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:58.279942 11504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:58.269301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:59675)
0811 12:40:58.270086 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:58.270109 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:58.270295 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:58.270666 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:58.270670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:58.271310 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:58.271463 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:58.271472 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.272626 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.272632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:58.273651 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:58.273662 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.274428 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.274435 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:58.274617 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:58.275332 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:58.275352 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:58.279567 (+ 4215us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":500,"threads_started":1}
W20260811 12:40:58.280144 11505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:58.269350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:59675 (local address 127.0.186.126:32799)
0811 12:40:58.270085 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:58.270091 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:58.270215 (+ 124us) server_negotiation.cc:407] Connection header received
0811 12:40:58.270433 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:58.270441 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:58.270509 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:58.270634 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:58.271630 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.272455 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.273804 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.274229 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.274361 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:58.279843 (+ 5482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:59675: BlockingRecv error: recv got EOF from 127.0.186.66:59675 (error 108)
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":453,"threads_started":1}
Aug 11 12:40:58 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:58 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:58.607807 11506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:58.597260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:52815)
0811 12:40:58.597935 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:58.597953 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:58.598152 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:58.598516 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:58.598521 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:58.598975 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:58.599227 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:58.599238 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.600445 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.600450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:58.601639 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:58.601653 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.602518 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.602525 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:58.602719 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:58.603322 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:58.603342 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:58.607538 (+ 4196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":414,"threads_started":1}
W20260811 12:40:58.608161 11505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:58.597299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:52815 (local address 127.0.186.126:32799)
0811 12:40:58.597475 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:58.597479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:58.598088 (+ 609us) server_negotiation.cc:407] Connection header received
0811 12:40:58.598284 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:58.598294 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:58.598368 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:58.598478 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:58.599403 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.600238 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.601797 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.602318 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.602489 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:58.607769 (+ 5280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:52815: BlockingRecv error: recv got EOF from 127.0.186.65:52815 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 12:40:58 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:58 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:58.703639 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:58.693007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:36037)
0811 12:40:58.693718 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:58.693735 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:58.693904 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:58.694279 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:58.694284 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:58.694779 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:58.694947 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:58.694960 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.696108 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.696117 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:58.697124 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:58.697136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.697908 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.697915 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:58.698098 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:58.698685 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:58.698704 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:58.703316 (+ 4612us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":448,"threads_started":1}
W20260811 12:40:58.703819 11505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:58.693191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:36037 (local address 127.0.186.126:32799)
0811 12:40:58.693464 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:58.693472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:58.693828 (+ 356us) server_negotiation.cc:407] Connection header received
0811 12:40:58.694036 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:58.694041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:58.694130 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:58.694242 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:58.695133 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.695962 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.697268 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:58.697717 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:58.697859 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:58.703564 (+ 5705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:36037: BlockingRecv error: recv got EOF from 127.0.186.67:36037 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 11 12:40:59 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:59 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:59.291328 11508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:59.281149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:47295)
0811 12:40:59.282047 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:59.282071 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:59.282217 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:59.282649 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:59.282653 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:59.283049 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:59.283236 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:59.283245 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.284318 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.284321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:59.285374 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:59.285388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.286103 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.286108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:59.286254 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:59.286868 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:59.286887 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:59.290895 (+ 4008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":364,"threads_started":1}
W20260811 12:40:59.291435 11509 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:59.281252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:47295 (local address 127.0.186.126:32799)
0811 12:40:59.282107 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:59.282113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:59.282135 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:40:59.282367 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:59.282372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:59.282456 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:59.282558 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:59.283385 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.284181 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.285516 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.285924 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.286027 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:59.291137 (+ 5110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:47295: BlockingRecv error: recv got EOF from 127.0.186.66:47295 (error 108)
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":606,"threads_started":1}
Aug 11 12:40:59 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:59 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:59.618928 11510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:59.608958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:52419)
0811 12:40:59.609554 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:59.609572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:59.609706 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:59.610201 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:59.610205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:59.610597 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:59.610783 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:59.610793 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.611987 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.611991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:59.613051 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:59.613066 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.613871 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.613876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:59.614074 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:59.614779 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:59.614798 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:59.618568 (+ 3770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":325,"threads_started":1}
W20260811 12:40:59.619109 11509 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:59.609180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:52419 (local address 127.0.186.126:32799)
0811 12:40:59.609354 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:59.609358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:59.609675 (+ 317us) server_negotiation.cc:407] Connection header received
0811 12:40:59.609799 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:59.609803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:59.609877 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:59.609973 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:59.611010 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.611784 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.613252 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.613717 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.613835 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:59.618812 (+ 4977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:52419: BlockingRecv error: recv got EOF from 127.0.186.65:52419 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 12:40:59 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:40:59 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:40:59.715790 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:40:59.704863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:52015)
0811 12:40:59.705541 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 12:40:59.705564 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:40:59.705736 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:40:59.706198 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:40:59.706204 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:40:59.706987 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:40:59.707203 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:59.707215 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.708614 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.708619 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:59.709917 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:40:59.709932 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.710808 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.710815 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:40:59.711037 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:59.711680 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:40:59.711699 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:40:59.715528 (+ 3829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":381,"threads_started":1}
W20260811 12:40:59.716176 11509 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:40:59.704938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:52015 (local address 127.0.186.126:32799)
0811 12:40:59.705277 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 12:40:59.705286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:40:59.705668 (+ 382us) server_negotiation.cc:407] Connection header received
0811 12:40:59.705882 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:40:59.705891 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:40:59.706026 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:40:59.706159 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:40:59.707372 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.708386 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.710111 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:40:59.710613 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:40:59.710773 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:40:59.715771 (+ 4998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:52015: BlockingRecv error: recv got EOF from 127.0.186.67:52015 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 11 12:41:00 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:00 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:00.303493 11512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:00.292471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:55713)
0811 12:41:00.293157 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:00.293179 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:00.293323 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:00.293732 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:00.293736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:00.294228 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:00.294491 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:00.294502 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.295658 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.295662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:00.296720 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:00.296798 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.297667 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.297673 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:00.297827 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:00.298624 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:00.298643 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:00.303133 (+ 4490us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":352,"threads_started":1}
W20260811 12:41:00.303735 11513 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:00.292630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:55713 (local address 127.0.186.126:32799)
0811 12:41:00.293289 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:00.293293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:00.293313 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:41:00.293452 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:00.293456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:00.293533 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:00.293645 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:00.294646 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.295508 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.297016 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.297491 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.297613 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:00.303397 (+ 5784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:55713: BlockingRecv error: recv got EOF from 127.0.186.66:55713 (error 108)
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":398,"threads_started":1}
Aug 11 12:41:00 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:00 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:00.630055 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:00.620310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:50699)
0811 12:41:00.620940 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:00.620958 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:00.621106 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:00.621419 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:00.621422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:00.621845 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:00.622021 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:00.622030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.623098 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.623102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:00.624167 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:00.624180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.624960 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.624965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:00.625130 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:00.625815 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:00.625834 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:00.629788 (+ 3954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":332,"threads_started":1}
W20260811 12:41:00.630252 11513 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:00.620517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:50699 (local address 127.0.186.126:32799)
0811 12:41:00.620809 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:00.620816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:00.621062 (+ 246us) server_negotiation.cc:407] Connection header received
0811 12:41:00.621218 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:00.621221 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:00.621286 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:00.621372 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:00.622158 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.622959 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.624321 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.624785 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.624950 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:00.630014 (+ 5064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:50699: BlockingRecv error: recv got EOF from 127.0.186.65:50699 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 11 12:41:00 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:00 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:00.726897 11515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:00.716837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:56993)
0811 12:41:00.717543 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:00.717563 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:00.717709 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:00.718087 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:00.718091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:00.718499 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:00.718685 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:00.718694 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.719788 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.719792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:00.720957 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:00.720972 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.721707 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.721712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:00.721858 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:00.722525 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:00.722544 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:00.726576 (+ 4032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":389,"threads_started":1}
W20260811 12:41:00.727147 11513 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:00.716957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:56993 (local address 127.0.186.126:32799)
0811 12:41:00.717139 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:00.717144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:00.717676 (+ 532us) server_negotiation.cc:407] Connection header received
0811 12:41:00.717830 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:00.717834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:00.717927 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:00.718018 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:00.718860 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.719614 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.721104 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:00.721512 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:00.721638 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:00.726810 (+ 5172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:56993: BlockingRecv error: recv got EOF from 127.0.186.67:56993 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 12:41:01 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:01 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:01.315524 11516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:01.304793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:35633)
0811 12:41:01.305426 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:01.305445 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:01.305570 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:01.306044 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:01.306048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:01.306451 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:01.306632 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:01.306641 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.307837 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.307841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:01.309343 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:01.309357 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.310233 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.310239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:01.310454 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:01.311175 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:01.311193 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:01.315230 (+ 4037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":320,"threads_started":1}
W20260811 12:41:01.315747 11517 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:01.304851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:35633 (local address 127.0.186.126:32799)
0811 12:41:01.305445 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:01.305449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:01.305508 (+ 59us) server_negotiation.cc:407] Connection header received
0811 12:41:01.305744 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:01.305748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:01.305812 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:01.305906 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:01.306798 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.307710 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.309501 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.310075 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.310220 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:01.315447 (+ 5227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:35633: BlockingRecv error: recv got EOF from 127.0.186.66:35633 (error 108)
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":368,"threads_started":1}
Aug 11 12:41:01 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:01 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:01.642305 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:01.631065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:45389)
0811 12:41:01.631688 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:01.631705 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:01.631829 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:01.632286 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:01.632291 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:01.632920 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:01.633156 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:01.633170 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.634294 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.634300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:01.635820 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:01.635836 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.636585 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.636591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:01.636808 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:01.637603 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:01.637630 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:01.641961 (+ 4331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":347,"threads_started":1}
W20260811 12:41:01.642462 11517 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:01.631276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:45389 (local address 127.0.186.126:32799)
0811 12:41:01.631474 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:01.631478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:01.631790 (+ 312us) server_negotiation.cc:407] Connection header received
0811 12:41:01.631934 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:01.631938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:01.632005 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:01.632137 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:01.633336 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.634144 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.635984 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.636420 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.636520 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:01.642230 (+ 5710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:45389: BlockingRecv error: recv got EOF from 127.0.186.65:45389 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 12:41:01 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:01 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:01.738835 11519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:01.728139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:44177)
0811 12:41:01.728644 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:01.728663 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:01.728908 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:01.729313 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:01.729318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:01.729798 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:01.730000 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:01.730011 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.731244 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.731251 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:01.732388 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:01.732401 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.733272 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.733279 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:01.733493 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:01.734163 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:01.734181 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:01.738533 (+ 4352us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":274,"threads_started":1}
W20260811 12:41:01.739153 11517 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:01.728195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44177 (local address 127.0.186.126:32799)
0811 12:41:01.728434 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:01.728443 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:01.728799 (+ 356us) server_negotiation.cc:407] Connection header received
0811 12:41:01.729064 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:01.729070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:01.729158 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:01.729279 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:01.730242 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.731076 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.732559 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:01.733109 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:01.733255 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:01.738811 (+ 5556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:44177: BlockingRecv error: recv got EOF from 127.0.186.67:44177 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 12:41:02 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:02 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:02.333313 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:02.316545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:38227)
0811 12:41:02.317137 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:02.317155 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:02.317266 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:02.317835 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:02.317839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:02.318305 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:02.318511 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:02.318521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.319696 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.319701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:02.320792 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:02.320807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.321578 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.321583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:02.321725 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:02.328955 (+ 7230us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:02.328982 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:02.333021 (+ 4039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":330,"threads_started":1}
W20260811 12:41:02.333712 11522 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:02.316880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:38227 (local address 127.0.186.126:32799)
0811 12:41:02.317542 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:02.317546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:02.317562 (+ 16us) server_negotiation.cc:407] Connection header received
0811 12:41:02.317610 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:02.317614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:02.317677 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:02.317766 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:02.318697 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.319524 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.320995 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.321422 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.321536 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:02.333350 (+ 11814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:38227: BlockingRecv error: recv got EOF from 127.0.186.66:38227 (error 108)
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":441,"threads_started":1}
Aug 11 12:41:02 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:02 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:02.654223 11523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:02.643568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:44327)
0811 12:41:02.644398 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:02.644416 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:02.644587 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:02.645012 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:02.645019 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:02.645510 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:02.645713 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:02.645722 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.646796 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.646801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:02.647779 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:02.647807 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.648581 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.648587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:02.648834 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:02.649526 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:02.649544 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:02.653822 (+ 4278us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":569,"threads_started":1}
W20260811 12:41:02.654332 11522 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:02.643623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:44327 (local address 127.0.186.126:32799)
0811 12:41:02.643840 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:02.643849 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:02.644514 (+ 665us) server_negotiation.cc:407] Connection header received
0811 12:41:02.644771 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:02.644776 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:02.644858 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:02.644973 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:02.645866 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.646648 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.647940 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.648393 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.648552 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:02.654086 (+ 5534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:44327: BlockingRecv error: recv got EOF from 127.0.186.65:44327 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 12:41:02 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:02 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:02.755182 11524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:02.739957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:48039)
0811 12:41:02.741177 (+ 1220us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:02.741201 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:02.741371 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:02.741932 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:02.741937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:02.742884 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:02.743187 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:02.743201 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.745336 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.745342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:02.747438 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:02.747456 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.748857 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.748865 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:02.749126 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:02.749941 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:02.749992 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:02.754781 (+ 4789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1073,"thread_start_us":853,"threads_started":1}
W20260811 12:41:02.755307 11522 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:02.740065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:48039 (local address 127.0.186.126:32799)
0811 12:41:02.740339 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:02.740351 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:02.741318 (+ 967us) server_negotiation.cc:407] Connection header received
0811 12:41:02.741538 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:02.741544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:02.741699 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:02.741875 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:02.743463 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.745134 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.747665 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:02.748411 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:02.748533 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:02.755018 (+ 6485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:48039: BlockingRecv error: recv got EOF from 127.0.186.67:48039 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 12:41:03 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:03 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:03.345681 11525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:03.334568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:39781)
0811 12:41:03.335327 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:03.335347 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:03.335481 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:03.335919 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:03.335923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:03.336424 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:03.336593 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:03.336603 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.337805 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.337842 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:03.338865 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:03.338879 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.339823 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.339827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:03.339966 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:03.340680 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:03.340698 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:03.345296 (+ 4598us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":447,"threads_started":1}
W20260811 12:41:03.345901 11526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:03.334679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:39781 (local address 127.0.186.126:32799)
0811 12:41:03.335428 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:03.335433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:03.335453 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:41:03.335642 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:03.335646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:03.335718 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:03.335824 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:03.336809 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.337629 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.339177 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.339650 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.339756 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:03.345586 (+ 5830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:39781: BlockingRecv error: recv got EOF from 127.0.186.66:39781 (error 108)
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":390,"threads_started":1}
Aug 11 12:41:03 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:03 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:03.665565 11527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:03.655563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:47685)
0811 12:41:03.656241 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:03.656258 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:03.656386 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:03.656810 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:03.656815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:03.657277 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:03.657482 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:03.657492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.658644 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.658654 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:03.659606 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:03.659618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.660359 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.660365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:03.660539 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:03.661295 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:03.661315 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:03.665279 (+ 3964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":310,"threads_started":1}
W20260811 12:41:03.665717 11526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:03.655697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:47685 (local address 127.0.186.126:32799)
0811 12:41:03.655879 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:03.655884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:03.656372 (+ 488us) server_negotiation.cc:407] Connection header received
0811 12:41:03.656497 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:03.656502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:03.656576 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:03.656766 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:03.657661 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.658476 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.659778 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.660195 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.660335 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:03.665491 (+ 5156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:47685: BlockingRecv error: recv got EOF from 127.0.186.65:47685 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 12:41:03 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:03 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 12:41:03.769459 11526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:03.756879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:49645 (local address 127.0.186.126:32799)
0811 12:41:03.757123 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:03.757129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:03.757378 (+ 249us) server_negotiation.cc:407] Connection header received
0811 12:41:03.757605 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:03.757611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:03.757699 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:03.757814 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:03.758701 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.759562 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.761595 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.762318 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.762465 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:03.769122 (+ 6657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:49645: BlockingRecv error: recv got EOF from 127.0.186.67:49645 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:41:03.770159 11528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:03.756608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:49645)
0811 12:41:03.757257 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:03.757274 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:03.757463 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:03.757854 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:03.757859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:03.758334 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:03.758534 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:03.758544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.759728 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.759735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:03.761440 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:03.761460 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:03.762769 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:03.762775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:03.763007 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:03.763773 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:03.763806 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:03.769725 (+ 5919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":410,"threads_started":1}
Aug 11 12:41:04 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:04 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:04.357728 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:04.346863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:35685)
0811 12:41:04.347666 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:04.347686 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:04.347867 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:04.348272 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:04.348276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:04.348814 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:04.349255 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:04.349271 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.350351 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.350355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:04.351434 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:04.351447 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.352523 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.352532 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:04.352768 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:04.353394 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:04.353413 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:04.357363 (+ 3950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":307,"threads_started":1}
W20260811 12:41:04.358021 11529 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:04.346946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:35685 (local address 127.0.186.126:32799)
0811 12:41:04.347582 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:04.347589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:04.347794 (+ 205us) server_negotiation.cc:407] Connection header received
0811 12:41:04.348036 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:04.348040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:04.348118 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:04.348209 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:04.349429 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.350213 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.351620 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.352312 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.352463 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:04.357612 (+ 5149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:35685: BlockingRecv error: recv got EOF from 127.0.186.66:35685 (error 108)
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":301,"threads_started":1}
Aug 11 12:41:04 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:04 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:04.677071 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:04.666680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:46849)
0811 12:41:04.667240 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:04.667257 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:04.667389 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:04.667731 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:04.667734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:04.668244 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:04.668434 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:04.668445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.669669 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.669673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:04.670726 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:04.670739 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.671596 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.671600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:04.671718 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:04.672455 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:04.672474 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:04.676664 (+ 4190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":289,"threads_started":1}
W20260811 12:41:04.677333 11529 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:04.666769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:46849 (local address 127.0.186.126:32799)
0811 12:41:04.667021 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:04.667028 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:04.667345 (+ 317us) server_negotiation.cc:407] Connection header received
0811 12:41:04.667495 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:04.667499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:04.667568 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:04.667656 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:04.668591 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.669534 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.670877 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.671385 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.671510 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:04.677056 (+ 5546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:46849: BlockingRecv error: recv got EOF from 127.0.186.65:46849 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 12:41:04 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:04 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:04.782356 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:04.771304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:44025)
0811 12:41:04.772254 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:04.772273 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:04.772466 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:04.772985 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:04.772991 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:04.773495 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:04.773691 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:04.773702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.774833 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.774839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:04.775975 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:04.775988 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.776824 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.776830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:04.777040 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:04.777768 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:04.777799 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:04.782117 (+ 4318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":847,"thread_start_us":536,"threads_started":1}
W20260811 12:41:04.782681 11529 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:04.771617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44025 (local address 127.0.186.126:32799)
0811 12:41:04.771991 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:04.772010 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:04.772377 (+ 367us) server_negotiation.cc:407] Connection header received
0811 12:41:04.772633 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:04.772638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:04.772724 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:04.772917 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:04.773864 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.774676 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.776136 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:04.776625 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:04.776810 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:04.782409 (+ 5599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:44025: BlockingRecv error: recv got EOF from 127.0.186.67:44025 (error 108)
Metrics: {"server-negotiator.queue_time_us":189}
Aug 11 12:41:05 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:05 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:05.369781 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:05.358974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:43853)
0811 12:41:05.359602 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:05.359619 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:05.359736 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:05.360162 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:05.360166 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:05.360615 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:05.360863 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:05.360874 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.362323 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.362327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:05.363483 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:05.363523 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.364666 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.364674 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:05.364910 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:05.365530 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:05.365548 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:05.369530 (+ 3982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":323,"threads_started":1}
W20260811 12:41:05.370160 11535 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:05.359138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:43853 (local address 127.0.186.126:32799)
0811 12:41:05.359716 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:05.359720 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:05.359739 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:41:05.359857 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:05.359860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:05.359921 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:05.360081 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:05.361042 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.362162 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.363684 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.364358 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.364478 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:05.369781 (+ 5303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:43853: BlockingRecv error: recv got EOF from 127.0.186.66:43853 (error 108)
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":362,"threads_started":1}
Aug 11 12:41:05 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:05 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:05.688905 11536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:05.678407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:57273)
0811 12:41:05.678950 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:05.678970 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:05.679108 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:05.679617 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:05.679623 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:05.680215 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:05.680427 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:05.680452 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.681846 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.681853 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:05.683002 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:05.683014 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.683819 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.683825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:05.684033 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:05.684616 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:05.684633 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:05.688550 (+ 3917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":655,"threads_started":1}
W20260811 12:41:05.689052 11535 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:05.678838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:57273 (local address 127.0.186.126:32799)
0811 12:41:05.679043 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:05.679050 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:05.679070 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:41:05.679321 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:05.679327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:05.679433 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:05.679569 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:05.680622 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.681689 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.683149 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.683630 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.683804 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:05.688804 (+ 5000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:57273: BlockingRecv error: recv got EOF from 127.0.186.65:57273 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 12:41:05 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:05 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:05.794232 11537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:05.783547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:57441)
0811 12:41:05.784186 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:05.784202 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:05.784318 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:05.784819 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:05.784824 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:05.785420 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:05.785638 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:05.785649 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.786752 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.786756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:05.787794 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:05.787807 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.788518 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.788523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:05.788651 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:05.789463 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:05.789483 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:05.793980 (+ 4497us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":361,"threads_started":1}
W20260811 12:41:05.794519 11535 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:05.783668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:57441 (local address 127.0.186.126:32799)
0811 12:41:05.783860 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:05.783866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:05.784304 (+ 438us) server_negotiation.cc:407] Connection header received
0811 12:41:05.784433 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:05.784438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:05.784538 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:05.784651 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:05.785798 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.786598 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.787926 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:05.788321 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:05.788423 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:05.794211 (+ 5788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:57441: BlockingRecv error: recv got EOF from 127.0.186.67:57441 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 12:41:06 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:06 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:06.381348 11538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:06.370891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:58387)
0811 12:41:06.371452 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:06.371470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:06.371603 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:06.372290 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:06.372298 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:06.372980 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:06.373193 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:06.373205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.374344 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.374348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:06.375327 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:06.375341 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.376117 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.376121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:06.376274 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:06.377053 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:06.377072 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:06.380998 (+ 3926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":281,"threads_started":1}
W20260811 12:41:06.381870 11540 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:06.371102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:58387 (local address 127.0.186.126:32799)
0811 12:41:06.371766 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:06.371772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:06.371789 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:41:06.371987 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:06.371993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:06.372082 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:06.372210 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:06.373343 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.374159 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.375512 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.375965 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.376066 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:06.381346 (+ 5280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:58387: BlockingRecv error: recv got EOF from 127.0.186.66:58387 (error 108)
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":428,"threads_started":1}
Aug 11 12:41:06 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:06 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:06.699770 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:06.689892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:34731)
0811 12:41:06.690531 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:06.690548 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:06.690668 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:06.691021 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:06.691025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:06.691425 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:06.691606 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:06.691615 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.692701 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.692705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:06.693816 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:06.693828 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.694623 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.694628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:06.694747 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:06.695535 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:06.695553 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:06.699513 (+ 3960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":366,"threads_started":1}
W20260811 12:41:06.699950 11540 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:06.689988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:34731 (local address 127.0.186.126:32799)
0811 12:41:06.690187 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:06.690192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:06.690634 (+ 442us) server_negotiation.cc:407] Connection header received
0811 12:41:06.690770 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:06.690774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:06.690838 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:06.690943 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:06.691758 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.692553 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.693964 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.694450 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.694579 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:06.699705 (+ 5126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:34731: BlockingRecv error: recv got EOF from 127.0.186.65:34731 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 12:41:06 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:06 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:06.805961 11542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:06.795287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:60677)
0811 12:41:06.796024 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:06.796052 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:06.796210 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:06.796683 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:06.796688 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:06.797201 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:06.797416 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:06.797432 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.798627 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.798632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:06.799605 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:06.799618 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.800385 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.800390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:06.800537 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:06.801330 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:06.801350 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:06.805651 (+ 4301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":328,"threads_started":1}
W20260811 12:41:06.806465 11540 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:06.795553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:60677 (local address 127.0.186.126:32799)
0811 12:41:06.795790 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:06.795796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:06.796190 (+ 394us) server_negotiation.cc:407] Connection header received
0811 12:41:06.796359 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:06.796364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:06.796509 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:06.796633 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:06.797604 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.798471 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.799771 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:06.800215 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:06.800320 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:06.805932 (+ 5612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:60677: BlockingRecv error: recv got EOF from 127.0.186.67:60677 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 11 12:41:07 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:07 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:07.399415 11544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:07.382511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:41325)
0811 12:41:07.383188 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:07.383208 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:07.383331 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:07.383706 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:07.383710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:07.384134 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:07.384309 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:07.384319 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.385428 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.385433 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:07.386600 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:07.386614 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.387399 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.387404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:07.387545 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:07.394800 (+ 7255us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:07.394852 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:07.399152 (+ 4300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":398,"threads_started":1}
W20260811 12:41:07.399693 11545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:07.382632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:41325 (local address 127.0.186.126:32799)
0811 12:41:07.383246 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:07.383250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:07.383269 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:41:07.383476 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:07.383480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:07.383542 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:07.383642 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:07.384473 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.385255 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.386752 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.387219 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.387327 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:07.399421 (+ 12094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:41325: BlockingRecv error: recv got EOF from 127.0.186.66:41325 (error 108)
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":358,"threads_started":1}
Aug 11 12:41:07 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:07 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:07.712090 11546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:07.700837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:60473)
0811 12:41:07.701534 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:07.701552 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:07.701677 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:07.702080 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:07.702084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:07.702570 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:07.702777 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:07.702787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.703882 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.703886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:07.705212 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:07.705228 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.706297 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.706306 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:07.706559 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:07.707477 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:07.707529 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:07.711739 (+ 4210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":404,"threads_started":1}
W20260811 12:41:07.712307 11545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:07.701145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:60473 (local address 127.0.186.126:32799)
0811 12:41:07.701383 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:07.701388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:07.701622 (+ 234us) server_negotiation.cc:407] Connection header received
0811 12:41:07.701812 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:07.701817 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:07.701880 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:07.702024 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:07.702941 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.703713 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.705432 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.706074 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.706250 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:07.712071 (+ 5821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:60473: BlockingRecv error: recv got EOF from 127.0.186.65:60473 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 11 12:41:07 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:07 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:07.817359 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:07.807191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:44411)
0811 12:41:07.807793 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:07.807811 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:07.808049 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:07.808428 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:07.808434 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:07.808925 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:07.809176 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:07.809188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.810277 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.810283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:07.811296 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:07.811308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.812078 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.812085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:07.812261 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:07.812976 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:07.812997 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:07.816979 (+ 3982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":343,"threads_started":1}
W20260811 12:41:07.817548 11545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:07.807353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:44411 (local address 127.0.186.126:32799)
0811 12:41:07.807584 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:07.807590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:07.807999 (+ 409us) server_negotiation.cc:407] Connection header received
0811 12:41:07.808200 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:07.808212 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:07.808277 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:07.808383 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:07.809337 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.810117 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.811464 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:07.811902 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:07.812041 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:07.817241 (+ 5200us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:44411: BlockingRecv error: recv got EOF from 127.0.186.67:44411 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 12:41:08 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:08 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:08.411034 11548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:08.400458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:38849)
0811 12:41:08.401097 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:08.401121 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:08.401264 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:08.401626 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:08.401629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:08.402123 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:08.402309 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:08.402348 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.403473 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.403477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:08.404549 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:08.404562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.405529 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.405534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:08.405680 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:08.406624 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:08.406655 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:08.410773 (+ 4118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":376,"threads_started":1}
W20260811 12:41:08.411367 11549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:08.400630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:38849 (local address 127.0.186.126:32799)
0811 12:41:08.401168 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:08.401173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:08.401191 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:41:08.401405 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:08.401409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:08.401471 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:08.401585 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:08.402564 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.403317 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.404688 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.405253 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.405460 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:08.410964 (+ 5504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:38849: BlockingRecv error: recv got EOF from 127.0.186.66:38849 (error 108)
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":313,"threads_started":1}
Aug 11 12:41:08 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:08 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:08.722127 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:08.713141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:51267)
0811 12:41:08.713674 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:08.713692 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:08.713809 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:08.714142 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:08.714146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:08.714558 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:08.714730 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:08.714739 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.715749 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.715753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:08.716716 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:08.716751 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.717494 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.717499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:08.717670 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:08.718354 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:08.718372 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:08.721867 (+ 3495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":269,"threads_started":1}
W20260811 12:41:08.722460 11549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:08.713222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:51267 (local address 127.0.186.126:32799)
0811 12:41:08.713468 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:08.713483 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:08.713794 (+ 311us) server_negotiation.cc:407] Connection header received
0811 12:41:08.713922 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:08.713927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:08.714002 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:08.714094 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:08.714860 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.715624 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.716885 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.717348 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.717449 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:08.722166 (+ 4717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:51267: BlockingRecv error: recv got EOF from 127.0.186.65:51267 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 12:41:08 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:08 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:08.828779 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:08.818491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:46453)
0811 12:41:08.819185 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:08.819203 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:08.819383 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:08.819778 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:08.819782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:08.820263 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:08.820457 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:08.820466 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.821595 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.821601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:08.822543 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:08.822555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.823355 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.823361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:08.823588 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:08.824528 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:08.824546 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:08.828386 (+ 3840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":361,"threads_started":1}
W20260811 12:41:08.828992 11549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:08.818701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:46453 (local address 127.0.186.126:32799)
0811 12:41:08.818974 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:08.818981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:08.819314 (+ 333us) server_negotiation.cc:407] Connection header received
0811 12:41:08.819553 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:08.819557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:08.819625 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:08.819742 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:08.820642 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.821449 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.822701 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:08.823186 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:08.823327 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:08.828646 (+ 5319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:46453: BlockingRecv error: recv got EOF from 127.0.186.67:46453 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 12:41:09 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:09 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:09.422667 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:09.412059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:48863)
0811 12:41:09.412620 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:09.412639 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:09.412836 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:09.413427 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:09.413431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:09.413835 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:09.414040 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:09.414051 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.415265 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.415269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:09.416277 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:09.416290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.417112 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.417117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:09.417291 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:09.418063 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:09.418087 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:09.422359 (+ 4272us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":312,"threads_started":1}
W20260811 12:41:09.422907 11555 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:09.412230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:48863 (local address 127.0.186.126:32799)
0811 12:41:09.413103 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:09.413107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:09.413124 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:41:09.413174 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:09.413177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:09.413247 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:09.413341 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:09.414236 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.415107 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.416436 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.416951 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.417097 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:09.422644 (+ 5547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:48863: BlockingRecv error: recv got EOF from 127.0.186.66:48863 (error 108)
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":616,"threads_started":1}
Aug 11 12:41:09 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:09 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:09.733707 11557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:09.723204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:55361)
0811 12:41:09.723797 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:09.723814 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:09.723952 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:09.724283 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:09.724286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:09.724722 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:09.724918 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:09.724927 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.726212 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.726217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:09.727390 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:09.727408 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.728183 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.728187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:09.728331 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:09.729181 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:09.729200 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:09.733281 (+ 4081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":347,"threads_started":1}
W20260811 12:41:09.733785 11555 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:09.723293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:55361 (local address 127.0.186.126:32799)
0811 12:41:09.723467 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:09.723472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:09.723976 (+ 504us) server_negotiation.cc:407] Connection header received
0811 12:41:09.724048 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:09.724051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:09.724148 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:09.724240 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:09.725126 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.726026 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.727571 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.728008 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.728122 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:09.733535 (+ 5413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:55361: BlockingRecv error: recv got EOF from 127.0.186.65:55361 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 12:41:09 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:09 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:09.840437 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:09.830210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:34685)
0811 12:41:09.830824 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:09.830842 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:09.831028 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:09.831418 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:09.831423 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:09.831869 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:09.832073 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:09.832083 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.833266 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.833273 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:09.834265 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:09.834277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.835135 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.835141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:09.835383 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:09.836160 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:09.836179 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:09.840041 (+ 3862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":361,"threads_started":1}
W20260811 12:41:09.840579 11555 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:09.830210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:34685 (local address 127.0.186.126:32799)
0811 12:41:09.830483 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:09.830492 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:09.830958 (+ 466us) server_negotiation.cc:407] Connection header received
0811 12:41:09.831168 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:09.831173 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:09.831251 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:09.831368 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:09.832237 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.833112 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.834415 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:09.834893 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:09.835028 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:09.840298 (+ 5270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:34685: BlockingRecv error: recv got EOF from 127.0.186.67:34685 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 12:41:10 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:10 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:10.434370 11559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:10.423785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:37239)
0811 12:41:10.424452 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:10.424470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:10.424615 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:10.425151 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:10.425154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:10.425598 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:10.425760 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:10.425771 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.426983 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.426987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:10.428275 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:10.428289 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.429404 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.429409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:10.429605 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:10.430335 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:10.430353 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:10.434123 (+ 3770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":350,"threads_started":1}
W20260811 12:41:10.434680 11561 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:10.424073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:37239 (local address 127.0.186.126:32799)
0811 12:41:10.424854 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:10.424858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:10.424875 (+ 17us) server_negotiation.cc:407] Connection header received
0811 12:41:10.424933 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:10.424937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:10.425003 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:10.425102 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:10.425990 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.426814 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.428506 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.429220 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.429368 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:10.434385 (+ 5017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:37239: BlockingRecv error: recv got EOF from 127.0.186.66:37239 (error 108)
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":528,"threads_started":1}
Aug 11 12:41:10 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:10 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.65@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:10.745947 11562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:10.735108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.65:50275)
0811 12:41:10.735619 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:10.735637 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:10.735754 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:10.736140 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:10.736144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:10.736573 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:10.736794 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:10.736804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.737945 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.737949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:10.739169 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:10.739183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.740178 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.740184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:10.740368 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:10.741044 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:10.741062 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:10.745488 (+ 4426us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":264,"threads_started":1}
W20260811 12:41:10.746088 11561 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:10.735210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:50275 (local address 127.0.186.126:32799)
0811 12:41:10.735481 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:10.735487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:10.735725 (+ 238us) server_negotiation.cc:407] Connection header received
0811 12:41:10.735864 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:10.735868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:10.735930 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:10.736070 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:10.736930 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.737766 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.739321 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.740009 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.740163 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:10.745745 (+ 5582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.65:50275: BlockingRecv error: recv got EOF from 127.0.186.65:50275 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 11 12:41:10 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:10 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.67@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:10.851673 11563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:10.841740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.67:47355)
0811 12:41:10.842340 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:10.842356 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:10.842532 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:10.842916 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:10.842924 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:10.843375 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:10.843558 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:10.843568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.844634 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.844640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:10.845661 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:10.845674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.846424 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.846430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:10.846635 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:10.847280 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:10.847298 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:10.851328 (+ 4030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":348,"threads_started":1}
W20260811 12:41:10.851917 11561 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:10.841843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:47355 (local address 127.0.186.126:32799)
0811 12:41:10.842231 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:10.842237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:10.842449 (+ 212us) server_negotiation.cc:407] Connection header received
0811 12:41:10.842696 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:10.842700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:10.842763 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:10.842872 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:10.843715 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.844480 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.845821 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:10.846262 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:10.846403 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:10.851624 (+ 5221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.67:47355: BlockingRecv error: recv got EOF from 127.0.186.67:47355 (error 108)
Metrics: {"server-negotiator.queue_time_us":218}
I20260811 12:41:11.408213 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11011
W20260811 12:41:11.422739 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11011: Not authorized: Client connection negotiation failed: client connection to 127.0.186.65:44987: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.0.186.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 12:41:11.422793 11565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:11.409726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52082 (local address 127.0.186.65:44987)
0811 12:41:11.410440 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:11.410448 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:11.410477 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:41:11.410545 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:11.410552 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:11.410789 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:11.410976 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:11.412721 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.413950 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.415266 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.415844 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.415957 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:11.419109 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:11.419119 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:11.419133 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:11.419174 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:11.421925 (+ 2751us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.0.186.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 12:41:11.422444 (+ 519us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52082: Request ticket server kudu/127.0.186.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":369,"threads_started":1}
W20260811 12:41:11.422917 11565 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52082: Request ticket server kudu/127.0.186.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 12:41:11.422979 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11011
Aug 11 12:41:11 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 12:41:11 dist-test-slave-qg60 krb5kdc[10317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.186.66@KRBTEST.COM for oryx/127.0.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 12:41:11.447106 11567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:11.435813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:32799 (local address 127.0.186.66:56509)
0811 12:41:11.436453 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:11.436483 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:11.436655 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:11.437229 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:11.437234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:11.437713 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:11.437896 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:11.437905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.439005 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.439009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:11.439957 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:11.439968 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.441421 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.441428 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:11.441638 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:11.442314 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:11.442332 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:11.446748 (+ 4416us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.186.126:32799: Server oryx/127.0.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":308,"threads_started":1}
W20260811 12:41:11.447603 11568 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:11.435973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:56509 (local address 127.0.186.126:32799)
0811 12:41:11.436908 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:11.436913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:11.436929 (+ 16us) server_negotiation.cc:407] Connection header received
0811 12:41:11.436984 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:11.436988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:11.437062 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:11.437189 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:11.438071 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.438836 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.440163 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.441245 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.441400 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:11.447069 (+ 5669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.186.66:56509: BlockingRecv error: recv got EOF from 127.0.186.66:56509 (error 108)
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":566,"threads_started":1}
I20260811 12:41:11.449936 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11184
I20260811 12:41:11.465142 11569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:11.451006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.0.186.66:34771)
0811 12:41:11.451771 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:11.451778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:11.451808 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:41:11.451874 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:11.451881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:11.452134 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:11.452302 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:11.454483 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.455719 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.457332 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.457961 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.458116 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:11.461259 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:11.461268 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:11.461282 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:11.461332 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:11.464288 (+ 2956us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.0.186.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 12:41:11.464614 (+ 326us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58048: Request ticket server kudu/127.0.186.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":301,"threads_started":1}
W20260811 12:41:11.465147 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11184: Not authorized: Client connection negotiation failed: client connection to 127.0.186.66:34771: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.0.186.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 12:41:11.465262 11569 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58048: Request ticket server kudu/127.0.186.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 12:41:11.465313 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11184
I20260811 12:41:11.489904 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11344
I20260811 12:41:11.506069 11570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:11.491307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.0.186.67:36325)
0811 12:41:11.491992 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:11.491999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:11.492029 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:41:11.492107 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:11.492114 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:11.492384 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:11.492580 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:11.495134 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.496637 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.498130 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:11.498826 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:11.498948 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:11.502186 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:11.502197 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:11.502214 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:11.502272 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:11.505426 (+ 3154us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.0.186.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 12:41:11.505741 (+ 315us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49030: Request ticket server kudu/127.0.186.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":343,"threads_started":1}
W20260811 12:41:11.506189 11570 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49030: Request ticket server kudu/127.0.186.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 12:41:11.506218 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11344: Not authorized: Client connection negotiation failed: client connection to 127.0.186.67:36325: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.0.186.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 12:41:11.506414 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11344
I20260811 12:41:11.532294 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 10928
I20260811 12:41:11.534027 11000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:11.659927 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 10928
2026-08-11T12:41:11Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22251 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T12:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:41:11Z Disabled control of system clock
I20260811 12:41:11.763537 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35803
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 12:41:12.137229 11575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:12.137560 11575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:12.137645 11575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:12.145288 11575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:41:12.145467 11575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:12.145565 11575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:12.145632 11575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:41:12.145678 11575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:41:12.155433 11575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35803
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:12.157011 11575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:12.158975 11575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:12.172119 11581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:12.172181 11585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:12.172206 11582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:12.172619 11575 server_base.cc:1034] running on GCE node
I20260811 12:41:12.173552 11575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:12.175113 11575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:12.176383 11575 hybrid_clock.cc:648] HybridClock initialized: now 1786452072176323 us; error 56 us; skew 500 ppm
I20260811 12:41:12.176853 11575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:12.179370 11575 webserver.cc:460] Webserver started at http://127.0.186.126:41493/ using document root <none> and password file <none>
I20260811 12:41:12.180181 11575 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:12.180315 11575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:12.180691 11575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:12.183825 11575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "d03484a0feb143c49cf0e6160b50b40c"
format_stamp: "Formatted at 2026-08-11 12:41:12 on dist-test-slave-qg60"
server_key: "4ac7b9e9c482c9cf5a7da0725da64552"
server_key_iv: "26f01531f73e85a979e393e5b6634e06"
server_key_version: "encryptionkey@0"
I20260811 12:41:12.184707 11575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "d03484a0feb143c49cf0e6160b50b40c"
format_stamp: "Formatted at 2026-08-11 12:41:12 on dist-test-slave-qg60"
server_key: "4ac7b9e9c482c9cf5a7da0725da64552"
server_key_iv: "26f01531f73e85a979e393e5b6634e06"
server_key_version: "encryptionkey@0"
I20260811 12:41:12.190351 11575 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 12:41:12.194248 11591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:12.195833 11575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 12:41:12.196070 11575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "d03484a0feb143c49cf0e6160b50b40c"
format_stamp: "Formatted at 2026-08-11 12:41:12 on dist-test-slave-qg60"
server_key: "4ac7b9e9c482c9cf5a7da0725da64552"
server_key_iv: "26f01531f73e85a979e393e5b6634e06"
server_key_version: "encryptionkey@0"
I20260811 12:41:12.196333 11575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:12.207674 11575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:12.208557 11575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:12.209020 11575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:12.229813 11575 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35803
I20260811 12:41:12.229836 11648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35803 every 8 connection(s)
I20260811 12:41:12.232090 11575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:41:12.237782 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11575
I20260811 12:41:12.238016 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:41:12.238359 11649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:41:12.238793 745 external_mini_cluster.cc:1428] Setting key 60ed93c3eea8e3e570578a58778c6f78
I20260811 12:41:12.254215 11654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:12.241721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41046 (local address 127.0.186.126:35803)
0811 12:41:12.242896 (+ 1175us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:12.242908 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:12.242952 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:41:12.244790 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:12.244823 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:12.245337 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:12.245772 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:12.246490 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:12.247859 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:12.249379 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:12.250089 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:12.250317 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:12.251616 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:12.251625 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:12.251641 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:12.252235 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:12.252322 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:12.252353 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:12.252486 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:12.252756 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 12:41:12.253152 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":1693,"threads_started":1}
I20260811 12:41:12.257916 11649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c: Bootstrap starting.
I20260811 12:41:12.262869 11649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c: Neither blocks nor log segments found. Creating new log.
I20260811 12:41:12.264467 11649 log.cc:824] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c: Log is configured to *not* fsync() on all Append() calls
I20260811 12:41:12.276222 11649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c: No bootstrap required, opened a new log
I20260811 12:41:12.284781 11649 raft_consensus.cc:348] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03484a0feb143c49cf0e6160b50b40c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35803 } }
I20260811 12:41:12.285418 11649 raft_consensus.cc:374] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:41:12.285568 11649 raft_consensus.cc:729] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03484a0feb143c49cf0e6160b50b40c, State: Initialized, Role: FOLLOWER
I20260811 12:41:12.286298 11649 consensus_queue.cc:260] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03484a0feb143c49cf0e6160b50b40c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35803 } }
I20260811 12:41:12.286603 11649 raft_consensus.cc:388] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:41:12.286777 11649 raft_consensus.cc:482] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:41:12.286962 11649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:41:12.289683 11649 raft_consensus.cc:504] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03484a0feb143c49cf0e6160b50b40c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35803 } }
I20260811 12:41:12.290364 11649 leader_election.cc:302] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d03484a0feb143c49cf0e6160b50b40c; no voters:
I20260811 12:41:12.291326 11649 leader_election.cc:288] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:41:12.291499 11656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:41:12.292366 11656 raft_consensus.cc:686] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [term 1 LEADER]: Becoming Leader. State: Replica: d03484a0feb143c49cf0e6160b50b40c, State: Running, Role: LEADER
I20260811 12:41:12.293193 11656 consensus_queue.cc:237] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03484a0feb143c49cf0e6160b50b40c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35803 } }
I20260811 12:41:12.293751 11649 sys_catalog.cc:564] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:41:12.296970 11658 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d03484a0feb143c49cf0e6160b50b40c. Latest consensus state: current_term: 1 leader_uuid: "d03484a0feb143c49cf0e6160b50b40c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03484a0feb143c49cf0e6160b50b40c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35803 } } }
I20260811 12:41:12.297497 11658 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [sys.catalog]: This master's current role is: LEADER
I20260811 12:41:12.308946 11662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:41:12.309511 11657 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d03484a0feb143c49cf0e6160b50b40c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03484a0feb143c49cf0e6160b50b40c" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35803 } } }
I20260811 12:41:12.309940 11657 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c [sys.catalog]: This master's current role is: LEADER
I20260811 12:41:12.316140 11662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:41:12.328819 11662 catalog_manager.cc:1347] Generated new cluster ID: 74d490722a2645d6abfeeddf80a73e6d
I20260811 12:41:12.328982 11662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:41:12.346391 11662 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:41:12.348453 11662 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:41:12.366802 11662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d03484a0feb143c49cf0e6160b50b40c: Generated new TSK 0
I20260811 12:41:12.367818 11662 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:41:12.376482 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35803
--builtin_ntp_servers=127.0.186.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 12:41:12.749457 11675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:12.749810 11675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:12.749912 11675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:12.757866 11675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:12.757983 11675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:12.758092 11675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:41:12.767676 11675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:12.769138 11675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:12.771231 11675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:12.785918 11683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:12.785959 11685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:12.786271 11681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:12.788012 11675 server_base.cc:1034] running on GCE node
I20260811 12:41:12.788825 11675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:12.789887 11675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:12.791143 11675 hybrid_clock.cc:648] HybridClock initialized: now 1786452072791075 us; error 60 us; skew 500 ppm
I20260811 12:41:12.791502 11675 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:12.801417 11675 webserver.cc:460] Webserver started at http://127.0.186.65:38351/ using document root <none> and password file <none>
I20260811 12:41:12.802309 11675 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:12.802464 11675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:12.802870 11675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:12.806154 11675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "3de5e78b33f243aebf8a06e70f2fbf6a"
format_stamp: "Formatted at 2026-08-11 12:41:12 on dist-test-slave-qg60"
server_key: "50f78639094fabb59cce90afae110b3f"
server_key_iv: "97ceb8f82eb4e6c20a3ecbd898b28024"
server_key_version: "encryptionkey@0"
I20260811 12:41:12.807036 11675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "3de5e78b33f243aebf8a06e70f2fbf6a"
format_stamp: "Formatted at 2026-08-11 12:41:12 on dist-test-slave-qg60"
server_key: "50f78639094fabb59cce90afae110b3f"
server_key_iv: "97ceb8f82eb4e6c20a3ecbd898b28024"
server_key_version: "encryptionkey@0"
I20260811 12:41:12.813555 11675 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 12:41:12.817569 11693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:12.819229 11675 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:41:12.819449 11675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "3de5e78b33f243aebf8a06e70f2fbf6a"
format_stamp: "Formatted at 2026-08-11 12:41:12 on dist-test-slave-qg60"
server_key: "50f78639094fabb59cce90afae110b3f"
server_key_iv: "97ceb8f82eb4e6c20a3ecbd898b28024"
server_key_version: "encryptionkey@0"
I20260811 12:41:12.819738 11675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:12.861341 11675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:12.862368 11675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:12.862735 11675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:12.863873 11675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:12.865581 11675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:12.865715 11675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:12.865865 11675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:12.865963 11675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:12.904006 11675 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:34191
I20260811 12:41:12.904111 11829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:34191 every 8 connection(s)
I20260811 12:41:12.905556 11675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:41:12.914441 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11675
I20260811 12:41:12.914682 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:41:12.915587 745 external_mini_cluster.cc:1428] Setting key 7addac132365819fb6e4ba85843b2115
I20260811 12:41:12.919201 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35803
--builtin_ntp_servers=127.0.186.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 12:41:12.920488 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:12.908413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:37657 (local address 127.0.186.126:35803)
0811 12:41:12.909029 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:12.909061 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:12.910611 (+ 1550us) server_negotiation.cc:407] Connection header received
0811 12:41:12.912524 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:12.912530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:12.912606 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:12.912714 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:12.914037 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:12.914879 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:12.917143 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:12.917816 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:12.917961 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:12.919700 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:12.919705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:12.919708 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:12.919727 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:12.919767 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:12.919779 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:12.919848 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:12.920132 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 12:41:12.920217 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":298,"threads_started":1}
I20260811 12:41:12.922184 11834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:12.909190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35803 (local address 127.0.186.65:37657)
0811 12:41:12.910428 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:12.910475 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:12.912190 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:12.913013 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:12.913023 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:12.913124 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:12.913743 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:12.913761 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:12.915078 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:12.915085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:12.916986 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:12.917000 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:12.918093 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:12.918103 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:12.918408 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:12.919265 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:41:12.919269 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:12.919332 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:41:12.919465 (+ 133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:12.919878 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:12.919891 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:12.919902 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 12:41:12.920099 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 12:41:12.920594 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":478,"threads_started":1}
I20260811 12:41:12.924149 11830 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35803
I20260811 12:41:12.924501 11830 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:12.925623 11830 heartbeater.cc:511] Master 127.0.186.126:35803 requested a full tablet report, sending...
I20260811 12:41:12.928156 11612 ts_manager.cc:194] Registered new tserver with Master: 3de5e78b33f243aebf8a06e70f2fbf6a (127.0.186.65:34191)
I20260811 12:41:12.930081 11612 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.65:37657
W20260811 12:41:13.293766 11836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:13.294109 11836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:13.294256 11836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:13.302150 11836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:13.302265 11836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:13.302465 11836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:41:13.312508 11836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:13.313995 11836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:13.315969 11836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:13.330863 11843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:13.330844 11844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:13.330844 11846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:13.332129 11836 server_base.cc:1034] running on GCE node
I20260811 12:41:13.332938 11836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:13.334044 11836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:13.335301 11836 hybrid_clock.cc:648] HybridClock initialized: now 1786452073335296 us; error 132 us; skew 500 ppm
I20260811 12:41:13.335767 11836 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:13.338629 11836 webserver.cc:460] Webserver started at http://127.0.186.66:44087/ using document root <none> and password file <none>
I20260811 12:41:13.339439 11836 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:13.339548 11836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:13.339973 11836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:13.343392 11836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "ba90f1b4961a452dba7b58cfc163ae44"
format_stamp: "Formatted at 2026-08-11 12:41:13 on dist-test-slave-qg60"
server_key: "55bcc7a0133aea21f834618470b1b6cc"
server_key_iv: "c720bb10f503a2bb65aaf05f5151cc76"
server_key_version: "encryptionkey@0"
I20260811 12:41:13.344352 11836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "ba90f1b4961a452dba7b58cfc163ae44"
format_stamp: "Formatted at 2026-08-11 12:41:13 on dist-test-slave-qg60"
server_key: "55bcc7a0133aea21f834618470b1b6cc"
server_key_iv: "c720bb10f503a2bb65aaf05f5151cc76"
server_key_version: "encryptionkey@0"
I20260811 12:41:13.350407 11836 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 12:41:13.354702 11855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:13.356235 11836 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:41:13.356452 11836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "ba90f1b4961a452dba7b58cfc163ae44"
format_stamp: "Formatted at 2026-08-11 12:41:13 on dist-test-slave-qg60"
server_key: "55bcc7a0133aea21f834618470b1b6cc"
server_key_iv: "c720bb10f503a2bb65aaf05f5151cc76"
server_key_version: "encryptionkey@0"
I20260811 12:41:13.356730 11836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:13.379127 11836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:13.380432 11836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:13.380837 11836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:13.382284 11836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:13.384377 11836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:13.384495 11836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:13.384626 11836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:13.384709 11836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:13.422679 11836 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:37935
I20260811 12:41:13.422811 11984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:37935 every 8 connection(s)
I20260811 12:41:13.424172 11836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:41:13.424494 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11836
I20260811 12:41:13.424666 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:41:13.425349 745 external_mini_cluster.cc:1428] Setting key 7f96ed8a3910c00bd21e4bae5a9b9ce6
I20260811 12:41:13.429186 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35803
--builtin_ntp_servers=127.0.186.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 12:41:13.437947 11989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:13.427354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:49881 (local address 127.0.186.126:35803)
0811 12:41:13.428021 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:13.428026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:13.429260 (+ 1234us) server_negotiation.cc:407] Connection header received
0811 12:41:13.431093 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:13.431099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:13.431194 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:13.431317 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:13.432453 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.433275 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.434883 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.435301 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.435442 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:13.437012 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:13.437017 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:13.437021 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:13.437043 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:13.437090 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:13.437103 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:13.437205 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:13.437448 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 12:41:13.437562 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":404,"threads_started":1}
I20260811 12:41:13.439082 11990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:13.427972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35803 (local address 127.0.186.66:49881)
0811 12:41:13.429101 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:13.429153 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:13.430812 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:13.431577 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:13.431587 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:13.431681 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:13.432276 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:13.432293 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.433440 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.433445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:13.434725 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:13.434744 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.435556 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.435573 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:13.435812 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:13.436603 (+ 791us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:41:13.436606 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:13.436649 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:41:13.436779 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:13.437206 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:13.437221 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:13.437231 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 12:41:13.437438 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 12:41:13.437907 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":357,"threads_started":1}
I20260811 12:41:13.440864 11986 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35803
I20260811 12:41:13.441287 11986 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:13.442212 11986 heartbeater.cc:511] Master 127.0.186.126:35803 requested a full tablet report, sending...
I20260811 12:41:13.444054 11612 ts_manager.cc:194] Registered new tserver with Master: ba90f1b4961a452dba7b58cfc163ae44 (127.0.186.66:37935)
I20260811 12:41:13.445350 11612 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.66:49881
W20260811 12:41:13.800669 11991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:13.801103 11991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:13.801239 11991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:13.809204 11991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:13.809405 11991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:13.809588 11991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:41:13.823222 11991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:13.825263 11991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:13.827883 11991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:13.847870 11998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:13.848124 11997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:13.848788 12000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:13.848968 11991 server_base.cc:1034] running on GCE node
I20260811 12:41:13.849870 11991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:13.851249 11991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:13.852519 11991 hybrid_clock.cc:648] HybridClock initialized: now 1786452073852445 us; error 65 us; skew 500 ppm
I20260811 12:41:13.852963 11991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:13.857076 11991 webserver.cc:460] Webserver started at http://127.0.186.67:33067/ using document root <none> and password file <none>
I20260811 12:41:13.858114 11991 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:13.858295 11991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:13.858770 11991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:13.863713 11991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "d22f65fbc99b4e498f72fa141aec1430"
format_stamp: "Formatted at 2026-08-11 12:41:13 on dist-test-slave-qg60"
server_key: "3890b18104e15c70c19b66bb902a4229"
server_key_iv: "f77f26d423175452bc3ec7e503478372"
server_key_version: "encryptionkey@0"
I20260811 12:41:13.865047 11991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "d22f65fbc99b4e498f72fa141aec1430"
format_stamp: "Formatted at 2026-08-11 12:41:13 on dist-test-slave-qg60"
server_key: "3890b18104e15c70c19b66bb902a4229"
server_key_iv: "f77f26d423175452bc3ec7e503478372"
server_key_version: "encryptionkey@0"
I20260811 12:41:13.874071 11991 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260811 12:41:13.879819 12007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:13.881431 11991 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 12:41:13.881645 11991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "d22f65fbc99b4e498f72fa141aec1430"
format_stamp: "Formatted at 2026-08-11 12:41:13 on dist-test-slave-qg60"
server_key: "3890b18104e15c70c19b66bb902a4229"
server_key_iv: "f77f26d423175452bc3ec7e503478372"
server_key_version: "encryptionkey@0"
I20260811 12:41:13.881897 11991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:13.901638 11991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:13.902586 11991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:13.902948 11991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:13.904059 11991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:13.905833 11991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:13.905966 11991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:13.906112 11991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:13.906199 11991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:13.934090 11830 heartbeater.cc:503] Master 127.0.186.126:35803 was elected leader, sending a full tablet report...
I20260811 12:41:13.944113 11991 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:38065
I20260811 12:41:13.944177 12139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:38065 every 8 connection(s)
I20260811 12:41:13.945624 11991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:41:13.955760 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 11991
I20260811 12:41:13.955968 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:41:13.956501 745 external_mini_cluster.cc:1428] Setting key 12ba9bab2ecb765aebb14c91ba006803
I20260811 12:41:13.961484 12142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:13.948530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:45157 (local address 127.0.186.126:35803)
0811 12:41:13.949148 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:13.949153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:13.950603 (+ 1450us) server_negotiation.cc:407] Connection header received
0811 12:41:13.953319 (+ 2716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:13.953324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:13.953406 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:13.953520 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:13.954673 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.955696 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.957877 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.958412 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.958567 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:13.960486 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:13.960493 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:13.960496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:13.960517 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:13.960580 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:13.960595 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:13.960683 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:13.960971 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 12:41:13.961156 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":328,"threads_started":1}
I20260811 12:41:13.962671 12144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:13.949118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35803 (local address 127.0.186.67:45157)
0811 12:41:13.950391 (+ 1273us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:13.950442 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:13.952979 (+ 2537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:13.953759 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:13.953768 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:13.953864 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:13.954468 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:13.954497 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.955932 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.955938 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:13.957692 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:13.957714 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.958677 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.958685 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:13.958961 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:13.960024 (+ 1063us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:41:13.960029 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:13.960149 (+ 120us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:41:13.960261 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:13.960684 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:13.960693 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:13.960699 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 12:41:13.960931 (+ 232us) client_negotiation.cc:240] Negotiation successful
0811 12:41:13.961389 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":395,"threads_started":1}
I20260811 12:41:13.964444 12140 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35803
I20260811 12:41:13.964859 12140 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:13.965700 12140 heartbeater.cc:511] Master 127.0.186.126:35803 requested a full tablet report, sending...
I20260811 12:41:13.967231 11612 ts_manager.cc:194] Registered new tserver with Master: d22f65fbc99b4e498f72fa141aec1430 (127.0.186.67:38065)
I20260811 12:41:13.968051 11612 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.67:45157
I20260811 12:41:13.972892 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 12:41:13.979866 12142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:13.978025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45668 (local address 127.0.186.126:35803)
0811 12:41:13.978276 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:13.978287 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:13.978772 (+ 485us) server_negotiation.cc:407] Connection header received
0811 12:41:13.978902 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:13.978907 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:13.978981 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:13.979121 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:13.979618 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45668: BlockingRecv error: recv got EOF from 127.0.0.1:45668 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:41:13.980640 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11675
I20260811 12:41:13.990011 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:13.981744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54450 (local address 127.0.186.65:34191)
0811 12:41:13.982362 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:13.982369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:13.982397 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:41:13.982471 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:13.982477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:13.982705 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:13.982843 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:13.983361 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.984419 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.985979 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:13.986733 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:13.986863 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:13.988269 (+ 1406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:13.988279 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:13.988292 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:13.989044 (+ 752us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:13.989113 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:13.989147 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:13.989250 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:13.989445 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 12:41:13.989589 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":276,"threads_started":1}
I20260811 12:41:13.991847 11824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:14.081384 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11675
I20260811 12:41:14.106142 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11836
I20260811 12:41:14.115584 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:14.107289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46134 (local address 127.0.186.66:37935)
0811 12:41:14.107994 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:14.108004 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:14.108040 (+ 36us) server_negotiation.cc:407] Connection header received
0811 12:41:14.108108 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:14.108114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:14.108340 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:14.108481 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:14.109169 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:14.110291 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:14.111676 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:14.112377 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:14.112501 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:14.113883 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:14.113891 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:14.113906 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:14.114610 (+ 704us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:14.114663 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:14.114686 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:14.114783 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:14.114984 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 12:41:14.115137 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":412,"threads_started":1}
I20260811 12:41:14.117085 11980 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:14.205924 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11836
I20260811 12:41:14.228145 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11991
I20260811 12:41:14.238695 12155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:14.229349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48628 (local address 127.0.186.67:38065)
0811 12:41:14.230232 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:14.230244 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:14.230286 (+ 42us) server_negotiation.cc:407] Connection header received
0811 12:41:14.230360 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:14.230369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:14.230672 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:14.230843 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:14.231297 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:14.233198 (+ 1901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:14.234624 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:14.235593 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:14.235730 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:14.237084 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:14.237095 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:14.237111 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:14.237767 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:14.237821 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:14.237845 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:14.237993 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:14.238135 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 12:41:14.238306 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":443,"threads_started":1}
I20260811 12:41:14.240247 12134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:14.327338 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11991
I20260811 12:41:14.349612 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 11575
I20260811 12:41:14.351073 11643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:14.459281 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 11575
2026-08-11T12:41:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2793 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T12:41:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:41:14Z Disabled control of system clock
I20260811 12:41:14.554787 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45057
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:45057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 12:41:14.915910 12161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:14.916220 12161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:14.916308 12161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:14.923800 12161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:41:14.923936 12161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:14.923977 12161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:14.924029 12161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:41:14.924075 12161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:41:14.933833 12161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:45057
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:14.935277 12161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:14.937225 12161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:14.949620 12167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:14.949707 12168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:14.949652 12170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:14.951133 12161 server_base.cc:1034] running on GCE node
I20260811 12:41:14.952067 12161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:14.954039 12161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:14.955320 12161 hybrid_clock.cc:648] HybridClock initialized: now 1786452074955196 us; error 106 us; skew 500 ppm
I20260811 12:41:14.955794 12161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:14.958806 12161 webserver.cc:460] Webserver started at http://127.0.186.126:35021/ using document root <none> and password file <none>
I20260811 12:41:14.959661 12161 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:14.959812 12161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:14.960240 12161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:14.963697 12161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "08c9d0d2d4e54bf79b82590e945e4488"
format_stamp: "Formatted at 2026-08-11 12:41:14 on dist-test-slave-qg60"
server_key: "001ac82e2f75189a25fa6d92b3d46a95"
server_key_iv: "17204a40c90e6a2a072063852dd32bfd"
server_key_version: "encryptionkey@0"
I20260811 12:41:14.964653 12161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "08c9d0d2d4e54bf79b82590e945e4488"
format_stamp: "Formatted at 2026-08-11 12:41:14 on dist-test-slave-qg60"
server_key: "001ac82e2f75189a25fa6d92b3d46a95"
server_key_iv: "17204a40c90e6a2a072063852dd32bfd"
server_key_version: "encryptionkey@0"
I20260811 12:41:14.970486 12161 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:41:14.974514 12177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:14.976052 12161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:41:14.976251 12161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "08c9d0d2d4e54bf79b82590e945e4488"
format_stamp: "Formatted at 2026-08-11 12:41:14 on dist-test-slave-qg60"
server_key: "001ac82e2f75189a25fa6d92b3d46a95"
server_key_iv: "17204a40c90e6a2a072063852dd32bfd"
server_key_version: "encryptionkey@0"
I20260811 12:41:14.976519 12161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:14.982966 12161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:14.983839 12161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:14.984189 12161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:15.005582 12161 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:45057
I20260811 12:41:15.005613 12236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:45057 every 8 connection(s)
I20260811 12:41:15.007390 12161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:41:15.011710 12237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:41:15.016625 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 12161
I20260811 12:41:15.016896 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:41:15.017760 745 external_mini_cluster.cc:1428] Setting key 2a30e204055f32b00fd047b899fe40bf
I20260811 12:41:15.024474 12237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488: Bootstrap starting.
I20260811 12:41:15.026767 12240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:15.020115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59052 (local address 127.0.186.126:45057)
0811 12:41:15.021338 (+ 1223us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:15.021349 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:15.021395 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:41:15.023198 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:15.023222 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:15.023629 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:15.024024 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:15.025162 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:15.025168 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:15.025181 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:15.025195 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:15.025253 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:15.025269 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:15.025499 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:15.025634 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 12:41:15.025877 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":395,"threads_started":1}
I20260811 12:41:15.027853 12237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488: Neither blocks nor log segments found. Creating new log.
I20260811 12:41:15.029023 12237 log.cc:824] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488: Log is configured to *not* fsync() on all Append() calls
I20260811 12:41:15.032017 12237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488: No bootstrap required, opened a new log
I20260811 12:41:15.039768 12237 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c9d0d2d4e54bf79b82590e945e4488" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45057 } }
I20260811 12:41:15.040189 12237 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:41:15.040302 12237 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c9d0d2d4e54bf79b82590e945e4488, State: Initialized, Role: FOLLOWER
I20260811 12:41:15.040963 12237 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c9d0d2d4e54bf79b82590e945e4488" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45057 } }
I20260811 12:41:15.041234 12237 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:41:15.041405 12237 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:41:15.041601 12237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:41:15.044142 12237 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c9d0d2d4e54bf79b82590e945e4488" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45057 } }
I20260811 12:41:15.044613 12237 leader_election.cc:302] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08c9d0d2d4e54bf79b82590e945e4488; no voters:
I20260811 12:41:15.045271 12237 leader_election.cc:288] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:41:15.045434 12245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:41:15.046234 12245 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [term 1 LEADER]: Becoming Leader. State: Replica: 08c9d0d2d4e54bf79b82590e945e4488, State: Running, Role: LEADER
I20260811 12:41:15.046851 12245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c9d0d2d4e54bf79b82590e945e4488" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45057 } }
I20260811 12:41:15.047525 12237 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:41:15.050057 12246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08c9d0d2d4e54bf79b82590e945e4488" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c9d0d2d4e54bf79b82590e945e4488" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45057 } } }
I20260811 12:41:15.050534 12246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [sys.catalog]: This master's current role is: LEADER
I20260811 12:41:15.051192 12248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08c9d0d2d4e54bf79b82590e945e4488. Latest consensus state: current_term: 1 leader_uuid: "08c9d0d2d4e54bf79b82590e945e4488" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c9d0d2d4e54bf79b82590e945e4488" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45057 } } }
I20260811 12:41:15.051628 12248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488 [sys.catalog]: This master's current role is: LEADER
I20260811 12:41:15.053217 12257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:41:15.058704 12257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:41:15.067731 12257 catalog_manager.cc:1347] Generated new cluster ID: b4e3c7b60f2543a9b7e770af72e14243
I20260811 12:41:15.067910 12257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:41:15.082909 12257 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:41:15.083391 12257 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:41:15.091841 12257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08c9d0d2d4e54bf79b82590e945e4488: Generated new TSK 0
I20260811 12:41:15.092782 12257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:41:15.104503 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45057
--builtin_ntp_servers=127.0.186.84:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 12:41:15.480661 12268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:15.481043 12268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:15.481216 12268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:15.488906 12268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:15.489017 12268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:15.489184 12268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:41:15.498971 12268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:15.500463 12268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:15.502480 12268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:15.517184 12277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:15.517161 12279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:15.517261 12276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:15.522524 12268 server_base.cc:1034] running on GCE node
I20260811 12:41:15.523242 12268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:15.524322 12268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:15.525584 12268 hybrid_clock.cc:648] HybridClock initialized: now 1786452075525526 us; error 36 us; skew 500 ppm
I20260811 12:41:15.525942 12268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:15.528451 12268 webserver.cc:460] Webserver started at http://127.0.186.65:44473/ using document root <none> and password file <none>
I20260811 12:41:15.529287 12268 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:15.529429 12268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:15.529774 12268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:15.533015 12268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "7ebabec4a42b4becb3c9b2477741c3f6"
format_stamp: "Formatted at 2026-08-11 12:41:15 on dist-test-slave-qg60"
server_key: "10467282859f4502e1d1f59f72e71106"
server_key_iv: "0e22b6601dfa0a80a9f9d8ad4988fb41"
server_key_version: "encryptionkey@0"
I20260811 12:41:15.533876 12268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "7ebabec4a42b4becb3c9b2477741c3f6"
format_stamp: "Formatted at 2026-08-11 12:41:15 on dist-test-slave-qg60"
server_key: "10467282859f4502e1d1f59f72e71106"
server_key_iv: "0e22b6601dfa0a80a9f9d8ad4988fb41"
server_key_version: "encryptionkey@0"
I20260811 12:41:15.539402 12268 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:41:15.543164 12287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:15.544628 12268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 12:41:15.544842 12268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "7ebabec4a42b4becb3c9b2477741c3f6"
format_stamp: "Formatted at 2026-08-11 12:41:15 on dist-test-slave-qg60"
server_key: "10467282859f4502e1d1f59f72e71106"
server_key_iv: "0e22b6601dfa0a80a9f9d8ad4988fb41"
server_key_version: "encryptionkey@0"
I20260811 12:41:15.545104 12268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:15.551314 12268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:15.552174 12268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:15.552520 12268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:15.553705 12268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:15.555294 12268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:15.555419 12268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:15.555553 12268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:15.555646 12268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:15.592458 12268 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:39555
I20260811 12:41:15.592555 12424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:39555 every 8 connection(s)
I20260811 12:41:15.593902 12268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:41:15.602617 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 12268
I20260811 12:41:15.602865 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:41:15.602895 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:15.596827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:37069 (local address 127.0.186.126:45057)
0811 12:41:15.597285 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:15.597290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:15.598561 (+ 1271us) server_negotiation.cc:407] Connection header received
0811 12:41:15.600407 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:15.600413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:15.600511 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:15.600636 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:15.602006 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:15.602013 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:15.602017 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:15.602043 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:15.602098 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:15.602121 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:15.602268 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:15.602468 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 12:41:15.602553 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":236,"threads_started":1}
I20260811 12:41:15.603586 745 external_mini_cluster.cc:1428] Setting key 3a6c58a8afb56f28cbfbdfb558cd3b2c
I20260811 12:41:15.603902 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:15.597454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45057 (local address 127.0.186.65:37069)
0811 12:41:15.598384 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:15.598426 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:15.600116 (+ 1690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:15.600924 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:15.600934 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:15.601031 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:15.601696 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:41:15.601698 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:15.601735 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:41:15.601823 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:15.602224 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:15.602240 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:15.602250 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 12:41:15.602556 (+ 306us) client_negotiation.cc:240] Negotiation successful
0811 12:41:15.602833 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":281,"threads_started":1}
I20260811 12:41:15.605576 12425 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45057
I20260811 12:41:15.605902 12425 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:15.606531 12425 heartbeater.cc:511] Master 127.0.186.126:45057 requested a full tablet report, sending...
I20260811 12:41:15.606917 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45057
--builtin_ntp_servers=127.0.186.84:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 12:41:15.608806 12197 ts_manager.cc:194] Registered new tserver with Master: 7ebabec4a42b4becb3c9b2477741c3f6 (127.0.186.65:39555)
W20260811 12:41:15.968175 12431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:15.968488 12431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:15.968582 12431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:15.976245 12431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:15.976368 12431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:15.976500 12431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:41:15.986348 12431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:15.987710 12431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:15.989821 12431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:16.004431 12441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:16.004410 12439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:16.004457 12437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:16.010720 12431 server_base.cc:1034] running on GCE node
I20260811 12:41:16.011600 12431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:16.013017 12431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:16.014314 12431 hybrid_clock.cc:648] HybridClock initialized: now 1786452076014243 us; error 50 us; skew 500 ppm
I20260811 12:41:16.014796 12431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:16.018025 12431 webserver.cc:460] Webserver started at http://127.0.186.66:39963/ using document root <none> and password file <none>
I20260811 12:41:16.019074 12431 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:16.019250 12431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:16.019662 12431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:16.024251 12431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "9ddb07ea02974322ab0063fcb93fa631"
format_stamp: "Formatted at 2026-08-11 12:41:16 on dist-test-slave-qg60"
server_key: "71f5c42e333c5d9dc2d6ba5dcb3e252e"
server_key_iv: "a284a85a0751f470d6945a7d8a14925c"
server_key_version: "encryptionkey@0"
I20260811 12:41:16.025496 12431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "9ddb07ea02974322ab0063fcb93fa631"
format_stamp: "Formatted at 2026-08-11 12:41:16 on dist-test-slave-qg60"
server_key: "71f5c42e333c5d9dc2d6ba5dcb3e252e"
server_key_iv: "a284a85a0751f470d6945a7d8a14925c"
server_key_version: "encryptionkey@0"
I20260811 12:41:16.032179 12431 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260811 12:41:16.036324 12448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:16.037976 12431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:41:16.038162 12431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "9ddb07ea02974322ab0063fcb93fa631"
format_stamp: "Formatted at 2026-08-11 12:41:16 on dist-test-slave-qg60"
server_key: "71f5c42e333c5d9dc2d6ba5dcb3e252e"
server_key_iv: "a284a85a0751f470d6945a7d8a14925c"
server_key_version: "encryptionkey@0"
I20260811 12:41:16.038412 12431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:16.044548 12431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:16.045444 12431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:16.045739 12431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:16.046808 12431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:16.048434 12431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:16.048578 12431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:16.048801 12431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:16.048928 12431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:16.086555 12431 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:38871
I20260811 12:41:16.086656 12583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:38871 every 8 connection(s)
I20260811 12:41:16.087940 12431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:41:16.091023 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 12431
I20260811 12:41:16.091257 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:41:16.091857 745 external_mini_cluster.cc:1428] Setting key 5bdfee04191677b7e8fc9077e1140f04
I20260811 12:41:16.095248 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45057
--builtin_ntp_servers=127.0.186.84:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 12:41:16.097942 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.090898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:50077 (local address 127.0.186.126:45057)
0811 12:41:16.092723 (+ 1825us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:16.092756 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:16.093156 (+ 400us) server_negotiation.cc:407] Connection header received
0811 12:41:16.095159 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:16.095164 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:16.095240 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:16.095369 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:16.097103 (+ 1734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:16.097107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:16.097111 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:16.097127 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:16.097159 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:16.097170 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:16.097318 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:16.097567 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 12:41:16.097644 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1675}
I20260811 12:41:16.098974 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.091744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45057 (local address 127.0.186.66:50077)
0811 12:41:16.092990 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:16.093035 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:16.094861 (+ 1826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:16.095638 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:16.095647 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:16.095786 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:16.096631 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:41:16.096634 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:16.096674 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:41:16.096843 (+ 169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:16.097273 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:16.097287 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:16.097296 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 12:41:16.097640 (+ 344us) client_negotiation.cc:240] Negotiation successful
0811 12:41:16.097913 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":389,"threads_started":1}
I20260811 12:41:16.100582 12584 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45057
I20260811 12:41:16.100947 12584 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:16.101617 12584 heartbeater.cc:511] Master 127.0.186.126:45057 requested a full tablet report, sending...
I20260811 12:41:16.103219 12197 ts_manager.cc:194] Registered new tserver with Master: 9ddb07ea02974322ab0063fcb93fa631 (127.0.186.66:38871)
W20260811 12:41:16.455963 12588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:16.456288 12588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:16.456384 12588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:16.463788 12588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:16.463912 12588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:16.464025 12588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:41:16.473405 12588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:16.474792 12588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:16.476768 12588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:16.490561 12595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:16.491209 12596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:16.491309 12598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:16.491554 12588 server_base.cc:1034] running on GCE node
I20260811 12:41:16.492244 12588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:16.493348 12588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:16.494624 12588 hybrid_clock.cc:648] HybridClock initialized: now 1786452076494552 us; error 61 us; skew 500 ppm
I20260811 12:41:16.495047 12588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:41:16.497804 12588 webserver.cc:460] Webserver started at http://127.0.186.67:33465/ using document root <none> and password file <none>
I20260811 12:41:16.498557 12588 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:16.498726 12588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:16.499101 12588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:16.502305 12588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "9a8ad71cb71d45bd8cdcff3414c8a15c"
format_stamp: "Formatted at 2026-08-11 12:41:16 on dist-test-slave-qg60"
server_key: "a45139168b09b24f003169fd34c5ba49"
server_key_iv: "15367bde78fa27ce274d3fba24e02c11"
server_key_version: "encryptionkey@0"
I20260811 12:41:16.503173 12588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "9a8ad71cb71d45bd8cdcff3414c8a15c"
format_stamp: "Formatted at 2026-08-11 12:41:16 on dist-test-slave-qg60"
server_key: "a45139168b09b24f003169fd34c5ba49"
server_key_iv: "15367bde78fa27ce274d3fba24e02c11"
server_key_version: "encryptionkey@0"
I20260811 12:41:16.508973 12588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 12:41:16.512600 12604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:16.514019 12588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:41:16.514232 12588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "9a8ad71cb71d45bd8cdcff3414c8a15c"
format_stamp: "Formatted at 2026-08-11 12:41:16 on dist-test-slave-qg60"
server_key: "a45139168b09b24f003169fd34c5ba49"
server_key_iv: "15367bde78fa27ce274d3fba24e02c11"
server_key_version: "encryptionkey@0"
I20260811 12:41:16.514494 12588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:16.520753 12588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:16.521606 12588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:16.521899 12588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:16.522925 12588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:16.524499 12588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:16.524639 12588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:16.524804 12588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:16.524895 12588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:16.564574 12588 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:35035
I20260811 12:41:16.564628 12736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:35035 every 8 connection(s)
I20260811 12:41:16.566062 12588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:41:16.569386 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 12588
I20260811 12:41:16.569581 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:41:16.570171 745 external_mini_cluster.cc:1428] Setting key 8e7b133ca12398652a1b43d71eef9063
I20260811 12:41:16.575801 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.568995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:46543 (local address 127.0.186.126:45057)
0811 12:41:16.570892 (+ 1897us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:16.570902 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:16.571285 (+ 383us) server_negotiation.cc:407] Connection header received
0811 12:41:16.573427 (+ 2142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:16.573432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:16.573504 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:16.573611 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:16.574929 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:16.574933 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:16.574936 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:16.574953 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:16.575042 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:16.575057 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:16.575159 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:16.575519 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 12:41:16.575575 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1744}
I20260811 12:41:16.576910 12741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.569529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45057 (local address 127.0.186.67:46543)
0811 12:41:16.570792 (+ 1263us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:16.570850 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:16.573089 (+ 2239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:16.573883 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:16.573891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:16.573990 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:16.574639 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:41:16.574641 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:16.574680 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:41:16.574768 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:16.575172 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:16.575181 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:16.575188 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 12:41:16.575609 (+ 421us) client_negotiation.cc:240] Negotiation successful
0811 12:41:16.575822 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":331,"threads_started":1}
I20260811 12:41:16.578378 12738 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45057
I20260811 12:41:16.578716 12738 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:16.579366 12738 heartbeater.cc:511] Master 127.0.186.126:45057 requested a full tablet report, sending...
I20260811 12:41:16.581132 12197 ts_manager.cc:194] Registered new tserver with Master: 9a8ad71cb71d45bd8cdcff3414c8a15c (127.0.186.67:35035)
I20260811 12:41:16.586048 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 12:41:16.592610 12428 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:41:16.590858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59060 (local address 127.0.186.126:45057)
0811 12:41:16.591026 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:16.591030 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:16.591534 (+ 504us) server_negotiation.cc:407] Connection header received
0811 12:41:16.591741 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:16.591752 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:16.591805 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:16.591911 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:16.592283 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59060: BlockingRecv error: recv got EOF from 127.0.0.1:59060 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:41:16.593941 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 12268
I20260811 12:41:16.598104 12749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.594933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58348 (local address 127.0.186.65:39555)
0811 12:41:16.595592 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:16.595601 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:16.595633 (+ 32us) server_negotiation.cc:407] Connection header received
0811 12:41:16.595704 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:16.595712 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:16.595962 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:16.596127 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:16.597230 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:16.597238 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:16.597252 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:16.597268 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:16.597320 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:16.597338 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:16.597515 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:16.597584 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 12:41:16.597686 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":305,"threads_started":1}
I20260811 12:41:16.599610 12419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:16.683377 12425 heartbeater.cc:503] Master 127.0.186.126:45057 was elected leader, sending a full tablet report...
I20260811 12:41:16.685088 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 12268
W20260811 12:41:16.706090 12181 connection.cc:535] server connection from 127.0.186.65:37069 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 12:41:16.706396 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 12431
I20260811 12:41:16.710410 12751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.707363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38170 (local address 127.0.186.66:38871)
0811 12:41:16.707969 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:16.708056 (+ 87us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:16.708086 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:41:16.708155 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:16.708162 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:16.708387 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:16.708518 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:16.709632 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:16.709640 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:16.709652 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:16.709675 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:16.709722 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:16.709737 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:16.709858 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:16.709935 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 12:41:16.710121 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":316,"threads_started":1}
I20260811 12:41:16.711814 12579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:16.801885 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 12431
I20260811 12:41:16.824093 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 12588
I20260811 12:41:16.828369 12755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:16.825255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39386 (local address 127.0.186.67:35035)
0811 12:41:16.826089 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:16.826096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:16.826129 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:41:16.826192 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:16.826199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:16.826452 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:16.826585 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:16.827508 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:16.827514 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:16.827525 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:41:16.827542 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:16.827582 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:41:16.827596 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:16.827734 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:16.827887 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 12:41:16.828029 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":476,"threads_started":1}
I20260811 12:41:16.829918 12730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:16.913842 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 12588
I20260811 12:41:16.936769 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 12161
I20260811 12:41:16.938138 12232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:17.051558 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 12161
2026-08-11T12:41:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2591 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:41:17 dist-test-slave-qg60 krb5kdc[12761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:41:17 dist-test-slave-qg60 krb5kdc[12761](info): set up 2 sockets
Aug 11 12:41:17 dist-test-slave-qg60 krb5kdc[12761](info): commencing operation
krb5kdc: starting...
W20260811 12:41:18.356122 745 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:41:18 dist-test-slave-qg60 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:41:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:41:18.694165 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:43533
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:43533
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:41:19.056036 12777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:19.056397 12777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:19.056603 12777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:19.064378 12777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:41:19.064523 12777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:19.064613 12777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:19.064702 12777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:41:19.064790 12777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:41:19.075276 12777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:43533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:43533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:19.076845 12777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:19.078692 12777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:19.091619 12783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:19.091639 12784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:19.091619 12786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:19.092530 12777 server_base.cc:1034] running on GCE node
I20260811 12:41:19.093525 12777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:19.095082 12777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:19.096354 12777 hybrid_clock.cc:648] HybridClock initialized: now 1786452079096285 us; error 57 us; skew 500 ppm
I20260811 12:41:19.096865 12777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:41:19 dist-test-slave-qg60 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452079, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:41:19.107597 12777 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:41:19.109428 12777 webserver.cc:460] Webserver started at http://127.0.186.126:35567/ using document root <none> and password file <none>
I20260811 12:41:19.110208 12777 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:19.110373 12777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:19.110705 12777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:19.114076 12777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "4f6e602d47fc4822ba7e729f90418363"
format_stamp: "Formatted at 2026-08-11 12:41:19 on dist-test-slave-qg60"
server_key: "c4ab9179b40e2f3ac5827219522b32f1"
server_key_iv: "859aad892acadd3a1cb76f01e48a0636"
server_key_version: "encryptionkey@0"
I20260811 12:41:19.114923 12777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "4f6e602d47fc4822ba7e729f90418363"
format_stamp: "Formatted at 2026-08-11 12:41:19 on dist-test-slave-qg60"
server_key: "c4ab9179b40e2f3ac5827219522b32f1"
server_key_iv: "859aad892acadd3a1cb76f01e48a0636"
server_key_version: "encryptionkey@0"
I20260811 12:41:19.120679 12777 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 12:41:19.124336 12794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:19.125874 12777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:41:19.126194 12777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "4f6e602d47fc4822ba7e729f90418363"
format_stamp: "Formatted at 2026-08-11 12:41:19 on dist-test-slave-qg60"
server_key: "c4ab9179b40e2f3ac5827219522b32f1"
server_key_iv: "859aad892acadd3a1cb76f01e48a0636"
server_key_version: "encryptionkey@0"
I20260811 12:41:19.126428 12777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:19.147084 12777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:19.152305 12777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:19.152679 12777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:19.173743 12777 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:43533
I20260811 12:41:19.173834 12853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:43533 every 8 connection(s)
I20260811 12:41:19.175357 12777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:41:19.178604 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 12777
I20260811 12:41:19.178864 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:41:19.179529 745 external_mini_cluster.cc:1428] Setting key ee81bb539e240510efa85833780118db
I20260811 12:41:19.179836 12854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:41:19.195549 12854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363: Bootstrap starting.
Aug 11 12:41:19 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:41:19.200053 12854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363: Neither blocks nor log segments found. Creating new log.
I20260811 12:41:19.201588 12854 log.cc:824] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363: Log is configured to *not* fsync() on all Append() calls
I20260811 12:41:19.205559 12854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363: No bootstrap required, opened a new log
I20260811 12:41:19.207064 12857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:19.181887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43200 (local address 127.0.186.126:43533)
0811 12:41:19.182864 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:19.182881 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:19.182947 (+ 66us) server_negotiation.cc:407] Connection header received
0811 12:41:19.185238 (+ 2291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:19.185269 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:19.185858 (+ 589us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:19.186372 (+ 514us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:19.187825 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:19.189926 (+ 2101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:19.191417 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:19.192676 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:19.192926 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:19.197368 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:19.197383 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:19.197408 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:19.197474 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:19.201783 (+ 4309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:19.202819 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:19.202827 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:19.202833 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:19.203016 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:19.203458 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:19.203463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:19.203490 (+ 27us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:19.204322 (+ 832us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:19.204673 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:19.205046 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 12:41:19.205520 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":449,"threads_started":1}
I20260811 12:41:19.214380 12854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6e602d47fc4822ba7e729f90418363" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43533 } }
I20260811 12:41:19.214867 12854 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:41:19.214972 12854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6e602d47fc4822ba7e729f90418363, State: Initialized, Role: FOLLOWER
I20260811 12:41:19.215575 12854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6e602d47fc4822ba7e729f90418363" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43533 } }
I20260811 12:41:19.215839 12854 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:41:19.215989 12854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:41:19.216197 12854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:41:19.218725 12854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6e602d47fc4822ba7e729f90418363" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43533 } }
I20260811 12:41:19.219265 12854 leader_election.cc:302] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f6e602d47fc4822ba7e729f90418363; no voters:
I20260811 12:41:19.219909 12854 leader_election.cc:288] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:41:19.220062 12860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:41:19.220765 12860 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [term 1 LEADER]: Becoming Leader. State: Replica: 4f6e602d47fc4822ba7e729f90418363, State: Running, Role: LEADER
I20260811 12:41:19.221472 12860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6e602d47fc4822ba7e729f90418363" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43533 } }
I20260811 12:41:19.222641 12854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:41:19.224557 12862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f6e602d47fc4822ba7e729f90418363. Latest consensus state: current_term: 1 leader_uuid: "4f6e602d47fc4822ba7e729f90418363" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6e602d47fc4822ba7e729f90418363" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43533 } } }
I20260811 12:41:19.224997 12862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [sys.catalog]: This master's current role is: LEADER
I20260811 12:41:19.224771 12863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f6e602d47fc4822ba7e729f90418363" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f6e602d47fc4822ba7e729f90418363" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 43533 } } }
I20260811 12:41:19.225152 12863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363 [sys.catalog]: This master's current role is: LEADER
I20260811 12:41:19.230629 12866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:41:19.236685 12866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:41:19.246536 12866 catalog_manager.cc:1347] Generated new cluster ID: d6e63a751ffa4a11b54dec966eb6c5c6
I20260811 12:41:19.246699 12866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:41:19.263901 12866 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:41:19.265409 12866 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:41:19.276420 12866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363: Generated new TSK 0
I20260811 12:41:19.277663 12866 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:41:19.369436 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43533
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:41:19.736404 12885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:19.736693 12885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:19.736886 12885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:19.744599 12885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:19.744714 12885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:19.744953 12885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:41:19.755252 12885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:19.756649 12885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:19.758219 12885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:19.771799 12893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:19.771844 12894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:19.772568 12885 server_base.cc:1034] running on GCE node
W20260811 12:41:19.772665 12896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:19.773334 12885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:19.774345 12885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:19.775599 12885 hybrid_clock.cc:648] HybridClock initialized: now 1786452079775552 us; error 37 us; skew 500 ppm
I20260811 12:41:19.775967 12885 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:41:19 dist-test-slave-qg60 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452079, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:41:19.779608 12885 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:41:19.781302 12885 webserver.cc:460] Webserver started at http://127.0.186.65:34211/ using document root <none> and password file <none>
I20260811 12:41:19.782168 12885 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:19.782341 12885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:19.782703 12885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:19.786289 12885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "a4186737e6ba47528663651f14824a41"
format_stamp: "Formatted at 2026-08-11 12:41:19 on dist-test-slave-qg60"
server_key: "6dba2d07c77a57faa56922d114b6f826"
server_key_iv: "9aef2ea8c9eb623c374d1fc43cec8ee2"
server_key_version: "encryptionkey@0"
I20260811 12:41:19.787174 12885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "a4186737e6ba47528663651f14824a41"
format_stamp: "Formatted at 2026-08-11 12:41:19 on dist-test-slave-qg60"
server_key: "6dba2d07c77a57faa56922d114b6f826"
server_key_iv: "9aef2ea8c9eb623c374d1fc43cec8ee2"
server_key_version: "encryptionkey@0"
I20260811 12:41:19.793220 12885 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 12:41:19.796958 12903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:19.798535 12885 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:41:19.798728 12885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "a4186737e6ba47528663651f14824a41"
format_stamp: "Formatted at 2026-08-11 12:41:19 on dist-test-slave-qg60"
server_key: "6dba2d07c77a57faa56922d114b6f826"
server_key_iv: "9aef2ea8c9eb623c374d1fc43cec8ee2"
server_key_version: "encryptionkey@0"
I20260811 12:41:19.798954 12885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:19.830277 12885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:19.835089 12885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:19.835417 12885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:19.836475 12885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:19.838001 12885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:19.838114 12885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:19.838274 12885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:19.838361 12885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:19.874610 12885 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:35903
I20260811 12:41:19.874702 13033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:35903 every 8 connection(s)
I20260811 12:41:19.876031 12885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:41:19.883963 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 12885
I20260811 12:41:19.884215 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:41:19.884974 745 external_mini_cluster.cc:1428] Setting key 4790072ded507dd08f4308fb3e9cd20c
Aug 11 12:41:19 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452079, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:41:19.899216 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:19.878943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:40071 (local address 127.0.186.126:43533)
0811 12:41:19.879418 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:19.879423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:19.880472 (+ 1049us) server_negotiation.cc:407] Connection header received
0811 12:41:19.882515 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:19.882521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:19.882626 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:19.882755 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:19.884540 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:19.885393 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:19.887142 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:19.887772 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:19.887941 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:19.891782 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:19.891791 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:19.891799 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:19.891847 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:19.895485 (+ 3638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:19.896256 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:19.896265 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:19.896271 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:19.896436 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:19.896929 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:19.896937 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:19.896943 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:19.897376 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:19.897538 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:19.898447 (+ 909us) server_negotiation.cc:299] Negotiation successful
0811 12:41:19.898717 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":240,"threads_started":1}
I20260811 12:41:19.900238 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:19.879542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:43533 (local address 127.0.186.65:40071)
0811 12:41:19.880292 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:19.880339 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:19.882216 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:19.883017 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:19.883026 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:19.883572 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:19.884356 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:19.884378 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:19.885585 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:19.885590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:19.886965 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:19.886985 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:19.888006 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:19.888011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:19.888235 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:19.888994 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:19.889019 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:19.891524 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:19.895649 (+ 4125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:41:19.895656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:41:19.895671 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:41:19.896126 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:41:19.896553 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:41:19.896556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:41:19.896558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:41:19.896818 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:41:19.897517 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:19.897527 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:19.897988 (+ 461us) client_negotiation.cc:769] Sending connection context
0811 12:41:19.898280 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 12:41:19.898836 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":310,"threads_started":1}
I20260811 12:41:19.901855 13034 heartbeater.cc:347] Connected to a master server at 127.0.186.126:43533
I20260811 12:41:19.902267 13034 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:19.903147 13034 heartbeater.cc:511] Master 127.0.186.126:43533 requested a full tablet report, sending...
I20260811 12:41:19.905798 12812 ts_manager.cc:194] Registered new tserver with Master: a4186737e6ba47528663651f14824a41 (127.0.186.65:35903)
I20260811 12:41:19.908044 12812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:40071
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:41:19.961035 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43533
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:41:20.320514 13040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:20.320900 13040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:20.321081 13040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:20.328773 13040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:20.328948 13040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:20.329160 13040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:41:20.339646 13040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:20.341073 13040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:20.342478 13040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:20.356510 13046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:20.356633 13050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:20.356673 13048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:20.357762 13040 server_base.cc:1034] running on GCE node
I20260811 12:41:20.358412 13040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:20.359421 13040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:20.360635 13040 hybrid_clock.cc:648] HybridClock initialized: now 1786452080360592 us; error 36 us; skew 500 ppm
I20260811 12:41:20.361003 13040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:41:20 dist-test-slave-qg60 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452080, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:41:20.364355 13040 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:41:20.366016 13040 webserver.cc:460] Webserver started at http://127.0.186.66:37927/ using document root <none> and password file <none>
I20260811 12:41:20.366750 13040 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:20.366858 13040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:20.367443 13040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:20.370890 13040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "398e85bf042c42738eccd165e1b46060"
format_stamp: "Formatted at 2026-08-11 12:41:20 on dist-test-slave-qg60"
server_key: "c8389d44008c42450fd058fae1747277"
server_key_iv: "c41f585b2fe9e371a24f09b01056803a"
server_key_version: "encryptionkey@0"
I20260811 12:41:20.371724 13040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "398e85bf042c42738eccd165e1b46060"
format_stamp: "Formatted at 2026-08-11 12:41:20 on dist-test-slave-qg60"
server_key: "c8389d44008c42450fd058fae1747277"
server_key_iv: "c41f585b2fe9e371a24f09b01056803a"
server_key_version: "encryptionkey@0"
I20260811 12:41:20.378047 13040 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 12:41:20.381937 13057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:20.383533 13040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:41:20.383744 13040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "398e85bf042c42738eccd165e1b46060"
format_stamp: "Formatted at 2026-08-11 12:41:20 on dist-test-slave-qg60"
server_key: "c8389d44008c42450fd058fae1747277"
server_key_iv: "c41f585b2fe9e371a24f09b01056803a"
server_key_version: "encryptionkey@0"
I20260811 12:41:20.383931 13040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:20.398005 13040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:20.402756 13040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:20.403100 13040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:20.404296 13040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:20.405872 13040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:20.405953 13040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:20.406095 13040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:20.406153 13040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:20.442983 13040 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:33451
I20260811 12:41:20.443081 13197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:33451 every 8 connection(s)
I20260811 12:41:20.444401 13040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:41:20.445878 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 13040
I20260811 12:41:20.446106 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:41:20.446712 745 external_mini_cluster.cc:1428] Setting key e212b76e2aa6686f25fa72d0cb5e585d
Aug 11 12:41:20 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452080, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:41:20.472653 13200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:20.447890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:59325 (local address 127.0.186.126:43533)
0811 12:41:20.448443 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:20.448447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:20.449936 (+ 1489us) server_negotiation.cc:407] Connection header received
0811 12:41:20.453054 (+ 3118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:20.453059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:20.453149 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:20.453253 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:20.455675 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:20.456482 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:20.459154 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:20.459618 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:20.459732 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:20.464606 (+ 4874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:20.464616 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:20.464622 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:20.464674 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:20.468608 (+ 3934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:20.469547 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:20.469555 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:20.469561 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:20.469734 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:20.470271 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:20.470280 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:20.470286 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:20.470693 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:20.470860 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:20.471804 (+ 944us) server_negotiation.cc:299] Negotiation successful
0811 12:41:20.472121 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":317,"threads_started":1}
I20260811 12:41:20.473506 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:20.448638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:43533 (local address 127.0.186.66:59325)
0811 12:41:20.449745 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:20.449798 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:20.452677 (+ 2879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:20.453580 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:20.453596 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:20.454494 (+ 898us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:20.455414 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:20.455445 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:20.456665 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:20.456673 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:20.458963 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:20.458984 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:20.459888 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:20.459898 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:20.460271 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:20.461204 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:20.461241 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:20.464306 (+ 3065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:20.468831 (+ 4525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:41:20.468839 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:41:20.468856 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:41:20.469383 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:41:20.469899 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:41:20.469903 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:41:20.469905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:41:20.470125 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:41:20.470865 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:20.470873 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:20.471306 (+ 433us) client_negotiation.cc:769] Sending connection context
0811 12:41:20.471616 (+ 310us) client_negotiation.cc:240] Negotiation successful
0811 12:41:20.472138 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":416,"threads_started":1}
I20260811 12:41:20.475338 13198 heartbeater.cc:347] Connected to a master server at 127.0.186.126:43533
I20260811 12:41:20.475724 13198 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:20.476567 13198 heartbeater.cc:511] Master 127.0.186.126:43533 requested a full tablet report, sending...
I20260811 12:41:20.478368 12812 ts_manager.cc:194] Registered new tserver with Master: 398e85bf042c42738eccd165e1b46060 (127.0.186.66:33451)
I20260811 12:41:20.479414 12812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:59325
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:41:20.525676 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43533
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:41:20.891847 13205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:41:20.892207 13205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:41:20.892381 13205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:41:20.900128 13205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:41:20.900295 13205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:41:20.900486 13205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:41:20.911280 13205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:43533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:41:20.911631 13034 heartbeater.cc:503] Master 127.0.186.126:43533 was elected leader, sending a full tablet report...
I20260811 12:41:20.912997 13205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:41:20.914500 13205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:41:20.928866 13212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:20.928762 13211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:41:20.928704 13215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:41:20.929677 13205 server_base.cc:1034] running on GCE node
I20260811 12:41:20.930403 13205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:41:20.931476 13205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:41:20.932760 13205 hybrid_clock.cc:648] HybridClock initialized: now 1786452080932662 us; error 53 us; skew 500 ppm
I20260811 12:41:20.933112 13205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:41:20 dist-test-slave-qg60 krb5kdc[12761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452080, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:41:20.936468 13205 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:41:20.938212 13205 webserver.cc:460] Webserver started at http://127.0.186.67:40207/ using document root <none> and password file <none>
I20260811 12:41:20.938992 13205 fs_manager.cc:359] Metadata directory not provided
I20260811 12:41:20.939145 13205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:41:20.939463 13205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:41:20.942853 13205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "54a22217bc2c4523b9dce7366a2fa9a6"
format_stamp: "Formatted at 2026-08-11 12:41:20 on dist-test-slave-qg60"
server_key: "6399d2196842cf4e1f452059b7626068"
server_key_iv: "1def40a006c9d8fa86f0d9cb80211457"
server_key_version: "encryptionkey@0"
I20260811 12:41:20.943709 13205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "54a22217bc2c4523b9dce7366a2fa9a6"
format_stamp: "Formatted at 2026-08-11 12:41:20 on dist-test-slave-qg60"
server_key: "6399d2196842cf4e1f452059b7626068"
server_key_iv: "1def40a006c9d8fa86f0d9cb80211457"
server_key_version: "encryptionkey@0"
I20260811 12:41:20.949754 13205 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 12:41:20.953598 13225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:20.955534 13205 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:41:20.955739 13205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "54a22217bc2c4523b9dce7366a2fa9a6"
format_stamp: "Formatted at 2026-08-11 12:41:20 on dist-test-slave-qg60"
server_key: "6399d2196842cf4e1f452059b7626068"
server_key_iv: "1def40a006c9d8fa86f0d9cb80211457"
server_key_version: "encryptionkey@0"
I20260811 12:41:20.956050 13205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:41:20.972857 13205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:41:20.978677 13205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:41:20.979053 13205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:41:20.980306 13205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:41:20.981864 13205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:41:20.981952 13205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:20.982048 13205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:41:20.982095 13205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:41:21.021287 13205 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:37039
I20260811 12:41:21.021354 13355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:37039 every 8 connection(s)
I20260811 12:41:21.022784 13205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:41:21.030550 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 13205
I20260811 12:41:21.030773 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:41:21.031378 745 external_mini_cluster.cc:1428] Setting key 49b3f8334268e564356f0a739d484a42
Aug 11 12:41:21 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452080, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:41:21.044323 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.025623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:48775 (local address 127.0.186.126:43533)
0811 12:41:21.026075 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.026080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.027236 (+ 1156us) server_negotiation.cc:407] Connection header received
0811 12:41:21.029187 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.029192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.029266 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.029370 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:21.031280 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.032366 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.034302 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.034752 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.034891 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.038679 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:21.038684 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:21.038688 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:21.038723 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:21.041454 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.042164 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.042168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.042170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.042302 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.042698 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.042701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.042703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.042973 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:21.043100 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.043780 (+ 680us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.043958 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":219,"threads_started":1}
I20260811 12:41:21.045359 13360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.026256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:43533 (local address 127.0.186.67:48775)
0811 12:41:21.027053 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:21.027099 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:21.028873 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:21.029589 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:21.029596 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:21.030298 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:41:21.031062 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.031090 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.032540 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.032545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.034151 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.034164 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.035011 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.035018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.035255 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.035950 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:41:21.036051 (+ 101us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:41:21.038449 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:41:21.041592 (+ 3143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:41:21.041599 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:41:21.041612 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:41:21.042047 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:41:21.042394 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:41:21.042397 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:41:21.042399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:41:21.042595 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:41:21.043096 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:41:21.043101 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:41:21.043430 (+ 329us) client_negotiation.cc:769] Sending connection context
0811 12:41:21.043694 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 12:41:21.044098 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":283,"threads_started":1}
I20260811 12:41:21.046871 13356 heartbeater.cc:347] Connected to a master server at 127.0.186.126:43533
I20260811 12:41:21.047225 13356 heartbeater.cc:464] Registering TS with master...
I20260811 12:41:21.048048 13356 heartbeater.cc:511] Master 127.0.186.126:43533 requested a full tablet report, sending...
I20260811 12:41:21.049638 12812 ts_manager.cc:194] Registered new tserver with Master: 54a22217bc2c4523b9dce7366a2fa9a6 (127.0.186.67:37039)
I20260811 12:41:21.050433 12812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:48775
I20260811 12:41:21.060009 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:41:21.078265 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.065083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.0.186.126:43533)
0811 12:41:21.065267 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.065272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.065837 (+ 565us) server_negotiation.cc:407] Connection header received
0811 12:41:21.065984 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.065988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.066058 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.066153 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:21.067585 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.068375 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.069787 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.070199 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.070296 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.072690 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:21.072695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:21.072698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:21.072798 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:21.075398 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.076136 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.076141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.076143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.076268 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.076601 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.076604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.076606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.077007 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:21.077230 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.077773 (+ 543us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.077964 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:41:21.082712 12812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:41:21.090255 12812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:41:21.129819 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.103896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:37039 (local address 127.0.0.1:35560)
0811 12:41:21.117747 (+ 13851us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:21.117826 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:21.118121 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:21.120611 (+ 2490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:21.120618 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:21.120658 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:41:21.121291 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.121308 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.124353 (+ 3045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.124359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.126879 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.126892 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.128846 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.128856 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.129053 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.129088 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 12:41:21.129175 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 12:41:21.129323 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12547,"mutex_wait_us":43,"thread_start_us":14959,"threads_started":1}
I20260811 12:41:21.129823 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.103999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35560 (local address 127.0.186.67:37039)
0811 12:41:21.118775 (+ 14776us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.118787 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.118828 (+ 41us) server_negotiation.cc:407] Connection header received
0811 12:41:21.119272 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.119279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.119524 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.119745 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:41:21.121544 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.123278 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.127094 (+ 3816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.128603 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.128772 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.129019 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.129275 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.129451 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14568,"thread_start_us":14354,"threads_started":1}
I20260811 12:41:21.130120 13375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.106334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54672 (local address 127.0.186.65:35903)
0811 12:41:21.119079 (+ 12745us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.119086 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.119109 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:41:21.119236 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.119245 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.119533 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.119745 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:41:21.120659 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.122869 (+ 2210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.126980 (+ 4111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.128132 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.128320 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.128614 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.129535 (+ 921us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.129717 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12580,"thread_start_us":12865,"threads_started":1}
I20260811 12:41:21.130504 13377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.120449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:33451 (local address 127.0.0.1:33548)
0811 12:41:21.121225 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:21.121247 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:21.121383 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:21.122328 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:21.122333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:21.122358 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:41:21.122744 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.122756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.124887 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.124893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.127226 (+ 2333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.127240 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.129596 (+ 2356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.129603 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.129778 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.129824 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 12:41:21.129920 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 12:41:21.130097 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"mutex_wait_us":1,"thread_start_us":418,"threads_started":1}
I20260811 12:41:21.130800 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.104598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35903 (local address 127.0.0.1:54672)
0811 12:41:21.118683 (+ 14085us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:21.118705 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:21.118843 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:21.119792 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:21.119803 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:21.119850 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:41:21.120377 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.120394 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.124121 (+ 3727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.124125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.126714 (+ 2589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.126731 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.128371 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.128378 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.128608 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.128680 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 12:41:21.128863 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 12:41:21.129102 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13947,"mutex_wait_us":25,"thread_start_us":11575,"threads_started":1}
I20260811 12:41:21.131265 13376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.119572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33548 (local address 127.0.186.66:33451)
0811 12:41:21.120324 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.120330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.121520 (+ 1190us) server_negotiation.cc:407] Connection header received
0811 12:41:21.121647 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.121656 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.121886 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.122073 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:41:21.122939 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.124719 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.127430 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.129094 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.129257 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.129428 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.130768 (+ 1340us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.130930 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":507,"threads_started":1}
I20260811 12:41:21.134346 13279 tablet_service.cc:1467] Processing CreateTablet for tablet 239ebb1ead21408eadb67f1ada2acd7d (DEFAULT_TABLE table=test-table [id=d4fc530b8e674c86a279ea5397210e1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:41:21.135654 13279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239ebb1ead21408eadb67f1ada2acd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:41:21.135175 12959 tablet_service.cc:1467] Processing CreateTablet for tablet 239ebb1ead21408eadb67f1ada2acd7d (DEFAULT_TABLE table=test-table [id=d4fc530b8e674c86a279ea5397210e1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:41:21.135176 13122 tablet_service.cc:1467] Processing CreateTablet for tablet 239ebb1ead21408eadb67f1ada2acd7d (DEFAULT_TABLE table=test-table [id=d4fc530b8e674c86a279ea5397210e1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:41:21.136637 12959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239ebb1ead21408eadb67f1ada2acd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:41:21.136655 13122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 239ebb1ead21408eadb67f1ada2acd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:41:21.147754 13378 tablet_bootstrap.cc:492] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Bootstrap starting.
I20260811 12:41:21.151964 13378 tablet_bootstrap.cc:654] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Neither blocks nor log segments found. Creating new log.
I20260811 12:41:21.153080 13379 tablet_bootstrap.cc:492] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Bootstrap starting.
I20260811 12:41:21.154003 13380 tablet_bootstrap.cc:492] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Bootstrap starting.
I20260811 12:41:21.155112 13378 log.cc:824] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Log is configured to *not* fsync() on all Append() calls
I20260811 12:41:21.156960 13379 tablet_bootstrap.cc:654] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Neither blocks nor log segments found. Creating new log.
I20260811 12:41:21.158018 13379 log.cc:824] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Log is configured to *not* fsync() on all Append() calls
I20260811 12:41:21.158274 13380 tablet_bootstrap.cc:654] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Neither blocks nor log segments found. Creating new log.
I20260811 12:41:21.158929 13378 tablet_bootstrap.cc:492] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: No bootstrap required, opened a new log
I20260811 12:41:21.159272 13378 ts_tablet_manager.cc:1397] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260811 12:41:21.160087 13380 log.cc:824] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Log is configured to *not* fsync() on all Append() calls
I20260811 12:41:21.161206 13379 tablet_bootstrap.cc:492] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: No bootstrap required, opened a new log
I20260811 12:41:21.161494 13379 ts_tablet_manager.cc:1397] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 12:41:21.163861 13380 tablet_bootstrap.cc:492] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: No bootstrap required, opened a new log
I20260811 12:41:21.164186 13380 ts_tablet_manager.cc:1397] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260811 12:41:21.169471 13379 raft_consensus.cc:348] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.169874 13379 raft_consensus.cc:374] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:41:21.169986 13379 raft_consensus.cc:729] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398e85bf042c42738eccd165e1b46060, State: Initialized, Role: FOLLOWER
I20260811 12:41:21.170655 13379 consensus_queue.cc:260] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.171864 13198 heartbeater.cc:503] Master 127.0.186.126:43533 was elected leader, sending a full tablet report...
I20260811 12:41:21.172220 13378 raft_consensus.cc:348] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.172601 13379 ts_tablet_manager.cc:1428] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260811 12:41:21.172698 13378 raft_consensus.cc:374] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:41:21.172852 13378 raft_consensus.cc:729] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a22217bc2c4523b9dce7366a2fa9a6, State: Initialized, Role: FOLLOWER
I20260811 12:41:21.173516 13378 consensus_queue.cc:260] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.179440 13380 raft_consensus.cc:348] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.179852 13380 raft_consensus.cc:374] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:41:21.179972 13380 raft_consensus.cc:729] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4186737e6ba47528663651f14824a41, State: Initialized, Role: FOLLOWER
I20260811 12:41:21.180855 13356 heartbeater.cc:503] Master 127.0.186.126:43533 was elected leader, sending a full tablet report...
I20260811 12:41:21.180648 13380 consensus_queue.cc:260] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.181907 13378 ts_tablet_manager.cc:1428] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Time spent starting tablet: real 0.023s user 0.016s sys 0.008s
I20260811 12:41:21.183557 13380 ts_tablet_manager.cc:1428] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Time spent starting tablet: real 0.019s user 0.015s sys 0.001s
W20260811 12:41:21.196832 13199 tablet.cc:2369] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:41:21.274614 13357 tablet.cc:2369] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:41:21.339569 13387 raft_consensus.cc:482] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:41:21.339929 13387 raft_consensus.cc:504] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.341781 13387 leader_election.cc:288] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54a22217bc2c4523b9dce7366a2fa9a6 (127.0.186.67:37039), 398e85bf042c42738eccd165e1b46060 (127.0.186.66:33451)
I20260811 12:41:21.349516 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.342227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:34653 (local address 127.0.186.67:37039)
0811 12:41:21.342438 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.342443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.343121 (+ 678us) server_negotiation.cc:407] Connection header received
0811 12:41:21.343336 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.343343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.343437 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.343543 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:41:21.344387 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.345390 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.347407 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.348295 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.348436 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.348489 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.349056 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.349253 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:41:21.349587 13388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.342293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:37039 (local address 127.0.186.65:34653)
0811 12:41:21.342951 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:21.342968 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:21.343159 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:21.343666 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:21.343671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:21.343707 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:41:21.344208 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.344226 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.345538 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.345543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.347215 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.347229 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.348553 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.348559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.348777 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.348822 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 12:41:21.349009 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 12:41:21.349119 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"spinlock_wait_cycles":26496,"thread_start_us":359,"threads_started":1}
I20260811 12:41:21.349704 13376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.343422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:38859 (local address 127.0.186.66:33451)
0811 12:41:21.343680 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.343686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.343879 (+ 193us) server_negotiation.cc:407] Connection header received
0811 12:41:21.344024 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.344029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.344117 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.344229 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:41:21.344943 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.345773 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.347679 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.348587 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.348793 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.348864 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.349281 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.349414 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260811 12:41:21.349750 13389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.343118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:33451 (local address 127.0.186.65:38859)
0811 12:41:21.343775 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 12:41:21.343789 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 12:41:21.343900 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:41:21.344250 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:41:21.344253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:41:21.344273 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:41:21.344716 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.344787 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.345926 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.345929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.347466 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:41:21.347481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.348874 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.348879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:41:21.349091 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.349125 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 12:41:21.349220 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 12:41:21.349349 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":301,"threads_started":1}
I20260811 12:41:21.350844 13145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239ebb1ead21408eadb67f1ada2acd7d" candidate_uuid: "a4186737e6ba47528663651f14824a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398e85bf042c42738eccd165e1b46060" is_pre_election: true
I20260811 12:41:21.350914 13302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239ebb1ead21408eadb67f1ada2acd7d" candidate_uuid: "a4186737e6ba47528663651f14824a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" is_pre_election: true
I20260811 12:41:21.351419 13145 raft_consensus.cc:2454] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4186737e6ba47528663651f14824a41 in term 0.
I20260811 12:41:21.351471 13302 raft_consensus.cc:2454] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4186737e6ba47528663651f14824a41 in term 0.
I20260811 12:41:21.352171 12905 leader_election.cc:302] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398e85bf042c42738eccd165e1b46060, a4186737e6ba47528663651f14824a41; no voters:
I20260811 12:41:21.352694 13387 raft_consensus.cc:2781] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:41:21.353045 13387 raft_consensus.cc:482] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:41:21.353212 13387 raft_consensus.cc:3037] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:41:21.355656 13387 raft_consensus.cc:504] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.356289 13387 leader_election.cc:288] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [CANDIDATE]: Term 1 election: Requested vote from peers 54a22217bc2c4523b9dce7366a2fa9a6 (127.0.186.67:37039), 398e85bf042c42738eccd165e1b46060 (127.0.186.66:33451)
I20260811 12:41:21.357012 13145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239ebb1ead21408eadb67f1ada2acd7d" candidate_uuid: "a4186737e6ba47528663651f14824a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398e85bf042c42738eccd165e1b46060"
I20260811 12:41:21.356982 13302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "239ebb1ead21408eadb67f1ada2acd7d" candidate_uuid: "a4186737e6ba47528663651f14824a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a22217bc2c4523b9dce7366a2fa9a6"
I20260811 12:41:21.357245 13302 raft_consensus.cc:3037] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:41:21.357255 13145 raft_consensus.cc:3037] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:41:21.360693 13302 raft_consensus.cc:2454] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4186737e6ba47528663651f14824a41 in term 1.
I20260811 12:41:21.360692 13145 raft_consensus.cc:2454] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4186737e6ba47528663651f14824a41 in term 1.
I20260811 12:41:21.361215 12905 leader_election.cc:302] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a22217bc2c4523b9dce7366a2fa9a6, a4186737e6ba47528663651f14824a41; no voters:
I20260811 12:41:21.361552 13387 raft_consensus.cc:2781] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:41:21.362212 13387 raft_consensus.cc:686] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 1 LEADER]: Becoming Leader. State: Replica: a4186737e6ba47528663651f14824a41, State: Running, Role: LEADER
I20260811 12:41:21.362732 13387 consensus_queue.cc:237] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } }
I20260811 12:41:21.367816 12811 catalog_manager.cc:5495] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4186737e6ba47528663651f14824a41 (127.0.186.65). New cstate: current_term: 1 leader_uuid: "a4186737e6ba47528663651f14824a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4186737e6ba47528663651f14824a41" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35903 } health_report { overall_health: HEALTHY } } }
W20260811 12:41:21.378928 13035 tablet.cc:2369] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:41:21.425721 13375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.419804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54686 (local address 127.0.186.65:35903)
0811 12:41:21.420023 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.420030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.420051 (+ 21us) server_negotiation.cc:407] Connection header received
0811 12:41:21.420176 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.420180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.420300 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.420445 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:41:21.420944 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.421798 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.423323 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.423873 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.424001 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.424545 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:41:21.425143 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:41:21.425267 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.425382 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.425458 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 12:41:21.435653 13145 raft_consensus.cc:1261] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 1 FOLLOWER]: Refusing update from remote peer a4186737e6ba47528663651f14824a41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:41:21.435912 13302 raft_consensus.cc:1261] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 1 FOLLOWER]: Refusing update from remote peer a4186737e6ba47528663651f14824a41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:41:21.436792 13390 consensus_queue.cc:1035] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398e85bf042c42738eccd165e1b46060" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 33451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:41:21.437211 13387 consensus_queue.cc:1035] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54a22217bc2c4523b9dce7366a2fa9a6" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 37039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:41:21.471218 13399 mvcc.cc:205] Tried to move back new op lower bound from 7317307725549146112 to 7317307725265440768. Current Snapshot: MvccSnapshot[applied={T|T < 7317307725549146112}]
I20260811 12:41:21.476717 12811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:41:21.477106 12811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:41:21.481444 12811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f6e602d47fc4822ba7e729f90418363: Sending DeleteTablet for 3 replicas of tablet 239ebb1ead21408eadb67f1ada2acd7d
I20260811 12:41:21.482764 13279 tablet_service.cc:1514] Processing DeleteTablet for tablet 239ebb1ead21408eadb67f1ada2acd7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:41:21 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:35560
I20260811 12:41:21.482824 12959 tablet_service.cc:1514] Processing DeleteTablet for tablet 239ebb1ead21408eadb67f1ada2acd7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:41:21 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:54672
I20260811 12:41:21.482811 13122 tablet_service.cc:1514] Processing DeleteTablet for tablet 239ebb1ead21408eadb67f1ada2acd7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:41:21 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:33548
I20260811 12:41:21.487475 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 12885
I20260811 12:41:21.498194 13412 tablet_replica.cc:330] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: stopping tablet replica
I20260811 12:41:21.498803 13412 raft_consensus.cc:2229] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:41:21.499431 13412 raft_consensus.cc:2258] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:41:21.504320 13412 ts_tablet_manager.cc:1905] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:41:21.507050 13409 tablet_replica.cc:330] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: stopping tablet replica
I20260811 12:41:21.507598 13409 raft_consensus.cc:2229] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:41:21.508180 13409 raft_consensus.cc:2258] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:41:21.509076 13410 tablet_replica.cc:330] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: stopping tablet replica
I20260811 12:41:21.509528 13410 raft_consensus.cc:2229] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:41:21.510241 13410 raft_consensus.cc:2258] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:41:21.511525 13412 ts_tablet_manager.cc:1918] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:41:21.511749 13412 log.cc:1196] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/239ebb1ead21408eadb67f1ada2acd7d
I20260811 12:41:21.512305 13412 ts_tablet_manager.cc:1939] T 239ebb1ead21408eadb67f1ada2acd7d P 54a22217bc2c4523b9dce7366a2fa9a6: Deleting consensus metadata
I20260811 12:41:21.513517 13409 ts_tablet_manager.cc:1905] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:41:21.513717 13410 ts_tablet_manager.cc:1905] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:41:21.514395 12796 catalog_manager.cc:4841] TS 54a22217bc2c4523b9dce7366a2fa9a6 (127.0.186.67:37039): tablet 239ebb1ead21408eadb67f1ada2acd7d (table test-table [id=d4fc530b8e674c86a279ea5397210e1f]) successfully deleted
Aug 11 12:41:21 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:41:21.520649 13409 ts_tablet_manager.cc:1918] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:41:21.520852 13409 log.cc:1196] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/239ebb1ead21408eadb67f1ada2acd7d
I20260811 12:41:21.520952 13410 ts_tablet_manager.cc:1918] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:41:21.521209 13410 log.cc:1196] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/239ebb1ead21408eadb67f1ada2acd7d
I20260811 12:41:21.521430 13409 ts_tablet_manager.cc:1939] T 239ebb1ead21408eadb67f1ada2acd7d P 398e85bf042c42738eccd165e1b46060: Deleting consensus metadata
I20260811 12:41:21.521946 13410 ts_tablet_manager.cc:1939] T 239ebb1ead21408eadb67f1ada2acd7d P a4186737e6ba47528663651f14824a41: Deleting consensus metadata
I20260811 12:41:21.523527 12796 catalog_manager.cc:4841] TS 398e85bf042c42738eccd165e1b46060 (127.0.186.66:33451): tablet 239ebb1ead21408eadb67f1ada2acd7d (table test-table [id=d4fc530b8e674c86a279ea5397210e1f]) successfully deleted
I20260811 12:41:21.524653 12799 catalog_manager.cc:4841] TS a4186737e6ba47528663651f14824a41 (127.0.186.65:35903): tablet 239ebb1ead21408eadb67f1ada2acd7d (table test-table [id=d4fc530b8e674c86a279ea5397210e1f]) successfully deleted
I20260811 12:41:21.529100 13375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.491653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54696 (local address 127.0.186.65:35903)
0811 12:41:21.491905 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.491914 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.500627 (+ 8713us) server_negotiation.cc:407] Connection header received
0811 12:41:21.500928 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.500935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.501051 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.501141 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:21.503258 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.504556 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.510656 (+ 6100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.511467 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.511620 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.521690 (+ 10070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:21.521709 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:21.521730 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:21.521791 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:21.525994 (+ 4203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.526793 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.526800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.526802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.526955 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.527397 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.527401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.527403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.527783 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:21.528106 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.528445 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.528719 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 12:41:21.530086 13028 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:21.638396 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 12885
I20260811 12:41:21.663381 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 13040
Aug 11 12:41:21 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:41:21.679785 13376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.664310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33550 (local address 127.0.186.66:33451)
0811 12:41:21.664496 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.664500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.664550 (+ 50us) server_negotiation.cc:407] Connection header received
0811 12:41:21.664839 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.664848 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.664953 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.665092 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:21.666397 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.667139 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.669173 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.669555 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.669682 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.673951 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:21.673970 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:21.673986 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:21.674024 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:21.677068 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.677837 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.677845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.677847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.677982 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.678331 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.678334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.678336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.678737 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:21.678984 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.679304 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.679480 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:41:21.680442 13191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:21.773093 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 13040
I20260811 12:41:21.794808 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 13205
Aug 11 12:41:21 dist-test-slave-qg60 krb5kdc[12761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:41:21.811158 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:41:21.795767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35574 (local address 127.0.186.67:37039)
0811 12:41:21.795967 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 12:41:21.795972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:41:21.795992 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:41:21.796176 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:41:21.796180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:41:21.796263 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:41:21.796352 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:41:21.797890 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.798634 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.800029 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:41:21.800417 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:41:21.800517 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:41:21.805304 (+ 4787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:41:21.805325 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:41:21.805342 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:41:21.805386 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:41:21.808350 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.809218 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.809226 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.809228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.809384 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:41:21.809751 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:41:21.809754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:41:21.809756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:41:21.810168 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:41:21.810394 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 12:41:21.810678 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 12:41:21.810859 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:41:21.811931 13351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:21.906816 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 13205
I20260811 12:41:21.929569 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 12777
I20260811 12:41:21.931010 12848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:41:22.048273 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 12777
2026-08-11T12:41:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4999 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:41:22 dist-test-slave-qg60 krb5kdc[13421](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:41:22 dist-test-slave-qg60 krb5kdc[13421](info): set up 2 sockets
Aug 11 12:41:22 dist-test-slave-qg60 krb5kdc[13421](info): commencing operation
krb5kdc: starting...
W20260811 12:41:23.292146 745 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:41:23 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:41:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:41:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/rangeradmin_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/rangeradmin_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/rangerlookup_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/rangerlookup_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
I20260811 12:41:23.772605 745 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVJER3t/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/postgres -l logfile start
2026-08-11 12:41:26.647 UTC [13459] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 12:41:26.647 UTC [13459] LOG: listening on IPv4 address "127.0.186.84", port 55109
2026-08-11 12:41:26.651 UTC [13459] LOG: listening on Unix socket "/tmp/.s.PGSQL.55109"
2026-08-11 12:41:26.678 UTC [13462] LOG: database system was shut down at 2026-08-11 12:41:24 UTC
2026-08-11 12:41:26.682 UTC [13459] LOG: database system is ready to accept connections
I20260811 12:41:27.762625 745 mini_postgres.cc:96] Postgres bound to 55109
2026-08-11 12:41:27.792 UTC [13472] FATAL: database "slave" does not exist
127.0.186.84:55109 - accepting connections
I20260811 12:41:27.794234 745 mini_ranger.cc:161] Starting Ranger...
I20260811 12:41:27.836319 745 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 12:41:28.432348 745 mini_ranger.cc:87] Created ranger Postgres database
I20260811 12:41:28.432489 745 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-admin
2026-08-11 12:41:28,841 [I] DB FLAVOR :POSTGRES
2026-08-11 12:41:28,842 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 12:41:28,842 [I] Checking connection..
2026-08-11 12:41:28,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 12:41:29,117 [I] Checking connection passed.
2026-08-11 12:41:29,117 [I] --------- Verifying version history table ---------
2026-08-11 12:41:29,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 12:41:29,391 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 12:41:29,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 12:41:29,662 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 12:41:29,662 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 12:41:29,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 12:41:29.930 UTC [13550] WARNING: there is no transaction in progress
2026-08-11 12:41:29,938 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 12:41:29,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 12:41:30,188 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 12:41:30,188 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 12:41:30,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 12:41:30,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 12:41:30,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-11 12:41:30,981 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 12:41:31,256 [I] Table x_portal_user does not exist in database ranger
2026-08-11 12:41:31,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 12:41:31,498 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 12:41:31,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 12:41:31,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 12:41:32,026 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 12:41:32,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 12:41:33.095 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.114 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.132 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.150 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.167 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.188 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.249 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.257 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.274 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.285 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.296 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.311 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.322 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.330 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.338 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:33.347 UTC [13672] WARNING: there is no transaction in progress
2026-08-11 12:41:34,113 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 12:41:34,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 12:41:34,374 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 12:41:34,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 12:41:34,647 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 12:41:34,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 12:41:34,909 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 12:41:34,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 12:41:35,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 12:41:35,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-11 12:41:35,693 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 12:41:35,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 12:41:35,966 [I] DB_PATCHES have already been applied
I20260811 12:41:35.974439 745 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVJER3t/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 12:41:35.974562 745 mini_ranger.cc:193] Using host: 127.0.186.84
I20260811 12:41:36.000468 745 mini_ranger.cc:227] Ranger admin URL: http://127.0.186.84:48137
Aug 11, 2026 12:41:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:41:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:41:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 12:41:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 12:41:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 12:41:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 12:41:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 12:41:37.257081 745 mini_ranger.cc:160] Time spent starting Ranger: real 9.463s user 0.004s sys 0.081s
Aug 11, 2026 12:41:58 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 12:41:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 12:41:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 12:41:58 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 12:41:59 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 12:42:00.114125 745 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/rangerkms_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/rangerkms_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.186.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.0.186.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 12:42:00 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452120, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 12:42:00.385995 745 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 12:42:00.419019 745 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 12:42:01.430326 745 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 12:42:01.430540 745 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms
I20260811 12:42:01.430699 745 mini_ranger_kms.cc:227] Using postgres at 127.0.186.84:55109
2026-08-11 12:42:01,969 [I] DB FLAVOR :POSTGRES
2026-08-11 12:42:01,969 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 12:42:01,969 [I] Checking connection
2026-08-11 12:42:01,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 12:42:02,223 [I] connection success
2026-08-11 12:42:02,224 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 12:42:02,224 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 12:42:02,224 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 12:42:02,476 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 12:42:02,476 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 12:42:02,477 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 12:42:02,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:55109/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 12:42:02,779 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 12:42:03.347282 745 mini_ranger_kms.cc:310] Created kms service
I20260811 12:42:03.570894 745 mini_ranger_kms.cc:326] Created kudu user
I20260811 12:42:03.620994 745 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 12:42:03 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452120, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:04.060817 745 mini_ranger_kms.cc:384] Added ranger policy
I20260811 12:42:04.061210 745 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 12:42:04.061259 745 mini_ranger_kms.cc:240] Using host: 127.0.186.84
I20260811 12:42:04.100047 745 mini_ranger_kms.cc:276] Ranger KMS PID: 13882
I20260811 12:42:04.100271 745 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.0.186.84:58271
Aug 11, 2026 12:42:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:42:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:42:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 12:42:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 12:42:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 12:42:05 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 12:42:06 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786452126, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.186.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:42:06.805284 745 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.419s user 0.146s sys 0.454s
I20260811 12:42:06.805686 745 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 12:42:06.805954 745 mini_ranger_kms.cc:401] 127.0.186.84:58271/kms/v1/keys
Aug 11 12:42:06 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452126, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.186.84@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
Aug 11 12:42:07 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452126, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.186.84@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
Aug 11 12:42:09 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:42:09.999121 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:40713
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:40713
--ranger_config_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:58271/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:42:10.455947 13941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:42:10.456301 13941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:42:10.456398 13941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:42:10.465382 13941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:42:10.465521 13941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:42:10.465570 13941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:42:10.465631 13941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:42:10.465719 13941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:42:10.477849 13941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal
--ranger_kms_url=127.0.186.84:58271/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:40713
--ranger_config_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:40713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:42:10.479282 13941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:42:10.480854 13941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:42:10.497557 13947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:10.497691 13949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:10.497705 13946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:42:10.499086 13941 server_base.cc:1034] running on GCE node
I20260811 12:42:10.500082 13941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:42:10.502018 13941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:42:10.503298 13941 hybrid_clock.cc:648] HybridClock initialized: now 1786452130503244 us; error 50 us; skew 500 ppm
I20260811 12:42:10.503731 13941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:42:10 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452130, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:42:10.515698 13941 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:42:10.517814 13941 webserver.cc:460] Webserver started at http://127.0.186.126:40743/ using document root <none> and password file <none>
I20260811 12:42:10.518550 13941 fs_manager.cc:359] Metadata directory not provided
I20260811 12:42:10.518657 13941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:42:10.519004 13941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:42:10 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452130, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:10.582818 13941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e"
format_stamp: "Formatted at 2026-08-11 12:42:10 on dist-test-slave-qg60"
server_key: "f8d5c6c9e8663cea8f456c4321f7e468"
server_key_iv: "4021f84daa9af086efa841b5377d74ac"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:10.583873 13941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e"
format_stamp: "Formatted at 2026-08-11 12:42:10 on dist-test-slave-qg60"
server_key: "f8d5c6c9e8663cea8f456c4321f7e468"
server_key_iv: "4021f84daa9af086efa841b5377d74ac"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:10.590579 13941 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.002s
I20260811 12:42:10.609380 13956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:10.611183 13941 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 12:42:10.611402 13941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e"
format_stamp: "Formatted at 2026-08-11 12:42:10 on dist-test-slave-qg60"
server_key: "f8d5c6c9e8663cea8f456c4321f7e468"
server_key_iv: "4021f84daa9af086efa841b5377d74ac"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:10.611675 13941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:42:10.638283 13941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:42:10.643389 13941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:42:10.643747 13941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:42:10.674675 13941 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:40713
I20260811 12:42:10.674749 14020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:40713 every 8 connection(s)
I20260811 12:42:10.676446 13941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:42:10.682437 14021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:42:10.685861 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 13941
I20260811 12:42:10.686100 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:42:10.686882 745 external_mini_cluster.cc:1428] Setting key d2ffece3c24c16c0a56f46690bddce42
I20260811 12:42:10.699410 14021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e: Bootstrap starting.
I20260811 12:42:10.704859 14021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e: Neither blocks nor log segments found. Creating new log.
I20260811 12:42:10.706411 14021 log.cc:824] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:42:10.710708 14021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e: No bootstrap required, opened a new log
Aug 11 12:42:10 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:42:10.723826 14021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40713 } }
I20260811 12:42:10.724390 14021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:42:10.724573 14021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87e95fecf3cf4fb7bb7e1c4d0edbcf3e, State: Initialized, Role: FOLLOWER
I20260811 12:42:10.725436 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:10.690006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40308 (local address 127.0.186.126:40713)
0811 12:42:10.701545 (+ 11539us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:10.701563 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:10.702034 (+ 471us) server_negotiation.cc:407] Connection header received
0811 12:42:10.704406 (+ 2372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:10.704430 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:10.704914 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:10.705405 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:10.706921 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:10.709461 (+ 2540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:10.710841 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:10.711539 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:10.711750 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:10.715995 (+ 4245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:10.716005 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:10.716025 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:10.716084 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:10.720355 (+ 4271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:10.721306 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:10.721313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:10.721320 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:10.721503 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:10.721930 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:10.721936 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:10.721938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:10.722563 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:10.722939 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:10.723480 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 12:42:10.723956 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11156,"thread_start_us":10832,"threads_started":1}
I20260811 12:42:10.725422 14021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40713 } }
I20260811 12:42:10.725878 14021 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:42:10.726207 14021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:42:10.726428 14021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:42:10.730652 14021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40713 } }
I20260811 12:42:10.731460 14021 leader_election.cc:302] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87e95fecf3cf4fb7bb7e1c4d0edbcf3e; no voters:
I20260811 12:42:10.732403 14021 leader_election.cc:288] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:42:10.732563 14026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:42:10.734306 14026 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [term 1 LEADER]: Becoming Leader. State: Replica: 87e95fecf3cf4fb7bb7e1c4d0edbcf3e, State: Running, Role: LEADER
I20260811 12:42:10.735266 14026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40713 } }
I20260811 12:42:10.737385 14021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:42:10.749231 14028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40713 } } }
I20260811 12:42:10.748647 14027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87e95fecf3cf4fb7bb7e1c4d0edbcf3e. Latest consensus state: current_term: 1 leader_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e95fecf3cf4fb7bb7e1c4d0edbcf3e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 40713 } } }
I20260811 12:42:10.751566 14028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [sys.catalog]: This master's current role is: LEADER
I20260811 12:42:10.752871 14027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e [sys.catalog]: This master's current role is: LEADER
I20260811 12:42:10.769855 14038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:42:10.777161 14038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:42:10.785703 14021 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 12:42:10.817356 14038 catalog_manager.cc:1347] Generated new cluster ID: 33238788673246a8824b71a8978b1fa6
I20260811 12:42:10.817597 14038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:42:10.837085 14038 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:42:10.839798 14038 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:42:10.850449 14038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e: Generated new TSK 0
I20260811 12:42:10.851974 14038 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:42:11.793800 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:58271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40713
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:42:12 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786452132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 12:42:12.360906 14078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:42:12.361323 14078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:42:12.361589 14078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:42:12.375685 14078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:42:12.375929 14078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:42:12.376375 14078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:42:12.399981 14078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.0.186.84:58271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:42:12.402127 14078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:42:12.404335 14078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:42:12.433450 14089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:12.435252 14094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:12.435626 14090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:42:12.440155 14078 server_base.cc:1034] running on GCE node
I20260811 12:42:12.441150 14078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:42:12.443151 14078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:42:12.444501 14078 hybrid_clock.cc:648] HybridClock initialized: now 1786452132444336 us; error 112 us; skew 500 ppm
I20260811 12:42:12.445056 14078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:42:12 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:42:12.449175 14078 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:42:12.451119 14078 webserver.cc:460] Webserver started at http://127.0.186.65:38915/ using document root <none> and password file <none>
I20260811 12:42:12.451967 14078 fs_manager.cc:359] Metadata directory not provided
I20260811 12:42:12.452139 14078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:42:12.452513 14078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:42:12 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:12.475907 14078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "1a5db7ebab6140148218305dd74d8bf3"
format_stamp: "Formatted at 2026-08-11 12:42:12 on dist-test-slave-qg60"
server_key: "98e357435032c69f1c31630bb517bf47"
server_key_iv: "d3c504075faddf2ae8eee6c1f8f53995"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:12.477766 14078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "1a5db7ebab6140148218305dd74d8bf3"
format_stamp: "Formatted at 2026-08-11 12:42:12 on dist-test-slave-qg60"
server_key: "98e357435032c69f1c31630bb517bf47"
server_key_iv: "d3c504075faddf2ae8eee6c1f8f53995"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:12.486164 14078 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260811 12:42:12.509879 14101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:12.511858 14078 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:42:12.512151 14078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "1a5db7ebab6140148218305dd74d8bf3"
format_stamp: "Formatted at 2026-08-11 12:42:12 on dist-test-slave-qg60"
server_key: "98e357435032c69f1c31630bb517bf47"
server_key_iv: "d3c504075faddf2ae8eee6c1f8f53995"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:12.512524 14078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:42:12.592350 14078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:42:12.599109 14078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:42:12.599493 14078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:42:12.602653 14078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:42:12.604882 14078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:42:12.605028 14078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:12.605268 14078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:42:12.605417 14078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:42:12 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:12.807984 14078 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:43425
I20260811 12:42:12.808044 14240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:43425 every 8 connection(s)
I20260811 12:42:12.809778 14078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:42:12.815331 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 14078
I20260811 12:42:12.815609 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:42:12.817430 745 external_mini_cluster.cc:1428] Setting key b2c97d697a18ecb5361b49219f3d956d
Aug 11 12:42:12 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:42:12.864073 14244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:12.820497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:42703 (local address 127.0.186.126:40713)
0811 12:42:12.838524 (+ 18027us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:12.838533 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:12.838562 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:42:12.838639 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:12.838647 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:12.838796 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:12.838934 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:12.841876 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:12.843242 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:12.846104 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:12.846622 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:12.846773 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:12.852630 (+ 5857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:12.852641 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:12.852649 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:12.852704 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:12.857076 (+ 4372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:12.858242 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:12.858251 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:12.858257 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:12.858440 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:12.861590 (+ 3150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:12.861597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:12.861600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:12.862033 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:12.862187 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:12.863325 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0811 12:42:12.863652 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17825,"thread_start_us":17599,"threads_started":1}
I20260811 12:42:12.866503 14245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:12.821984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40713 (local address 127.0.186.65:42703)
0811 12:42:12.832146 (+ 10162us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:12.832221 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:12.835447 (+ 3226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:12.839612 (+ 4165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:12.839631 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:12.840457 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:42:12.841596 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:12.841633 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:12.843540 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:12.843548 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:12.845873 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:12.845891 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:12.846925 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:12.846935 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:12.847331 (+ 396us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:12.848295 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:42:12.848330 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:42:12.852272 (+ 3942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:42:12.857323 (+ 5051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:42:12.857336 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:42:12.857360 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:42:12.858081 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:42:12.860968 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:42:12.860973 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:42:12.860977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:42:12.861409 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:42:12.862295 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:42:12.862305 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:42:12.862836 (+ 531us) client_negotiation.cc:769] Sending connection context
0811 12:42:12.864331 (+ 1495us) client_negotiation.cc:240] Negotiation successful
0811 12:42:12.864998 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9786,"thread_start_us":9271,"threads_started":1}
I20260811 12:42:12.869019 14241 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40713
I20260811 12:42:12.869432 14241 heartbeater.cc:464] Registering TS with master...
I20260811 12:42:12.870332 14241 heartbeater.cc:511] Master 127.0.186.126:40713 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
I20260811 12:42:12.873286 13979 ts_manager.cc:194] Registered new tserver with Master: 1a5db7ebab6140148218305dd74d8bf3 (127.0.186.65:43425)
I20260811 12:42:12.875397 13979 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:42703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:42:12.921831 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:58271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40713
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:42:13 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
W20260811 12:42:13.463356 14248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:42:13.463734 14248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:42:13.463919 14248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:42:13.472134 14248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:42:13.472309 14248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:42:13.472504 14248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:42:13.483210 14248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.0.186.84:58271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:42:13.484705 14248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:42:13.486245 14248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:42:13.505383 14263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:13.516760 14264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:13.518138 14266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:42:13.519284 14248 server_base.cc:1034] running on GCE node
I20260811 12:42:13.520074 14248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:42:13.521426 14248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:42:13.522809 14248 hybrid_clock.cc:648] HybridClock initialized: now 1786452133522707 us; error 65 us; skew 500 ppm
I20260811 12:42:13.523267 14248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:42:13 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452133, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:42:13.526988 14248 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:42:13.529181 14248 webserver.cc:460] Webserver started at http://127.0.186.66:35161/ using document root <none> and password file <none>
I20260811 12:42:13.530045 14248 fs_manager.cc:359] Metadata directory not provided
I20260811 12:42:13.530200 14248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:42:13.530627 14248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:42:13 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452133, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:13.551798 14248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "2adc693a8cb74ce4990789ef3fea6bfc"
format_stamp: "Formatted at 2026-08-11 12:42:13 on dist-test-slave-qg60"
server_key: "75e35df3d8871972a578b920978c6c1b"
server_key_iv: "a452e8637cc0be75b82dd11e7ef8d343"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:13.553184 14248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "2adc693a8cb74ce4990789ef3fea6bfc"
format_stamp: "Formatted at 2026-08-11 12:42:13 on dist-test-slave-qg60"
server_key: "75e35df3d8871972a578b920978c6c1b"
server_key_iv: "a452e8637cc0be75b82dd11e7ef8d343"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:13.572376 14248 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.008s sys 0.008s
I20260811 12:42:13.610031 14273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:13.612655 14248 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.007s sys 0.007s
I20260811 12:42:13.613031 14248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "2adc693a8cb74ce4990789ef3fea6bfc"
format_stamp: "Formatted at 2026-08-11 12:42:13 on dist-test-slave-qg60"
server_key: "75e35df3d8871972a578b920978c6c1b"
server_key_iv: "a452e8637cc0be75b82dd11e7ef8d343"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:13.613479 14248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:42:13.663878 14248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:42:13.669674 14248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:42:13.670127 14248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:42:13.677791 14248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:42:13.686195 14248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:42:13.686394 14248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:42:13.686582 14248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:42:13.686690 14248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:13.736402 14248 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:45287
I20260811 12:42:13.736421 14406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:45287 every 8 connection(s)
I20260811 12:42:13.738155 14248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:42:13.743678 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 14248
I20260811 12:42:13.743886 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:42:13.744463 745 external_mini_cluster.cc:1428] Setting key 5fc977d9f2ad33588f52930abda64631
Aug 11 12:42:13 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452133, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:42:13.765823 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:13.741258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:60201 (local address 127.0.186.126:40713)
0811 12:42:13.741906 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:13.741912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:13.743151 (+ 1239us) server_negotiation.cc:407] Connection header received
0811 12:42:13.745944 (+ 2793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:13.745950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:13.746027 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:13.746155 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:13.748202 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:13.749527 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:13.752054 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:13.752919 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:13.753104 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:13.757830 (+ 4726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:13.757840 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:13.757848 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:13.757907 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:13.761953 (+ 4046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:13.762788 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:13.762794 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:13.762797 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:13.762955 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:13.763589 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:13.763594 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:13.763598 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:13.763973 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:13.764145 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:13.765164 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0811 12:42:13.765414 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":334,"threads_started":1}
I20260811 12:42:13.767279 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:13.741868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40713 (local address 127.0.186.66:60201)
0811 12:42:13.742937 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:13.742993 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:13.745617 (+ 2624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:13.746439 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:13.746451 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:13.747117 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:42:13.747979 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:13.748005 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:13.749731 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:13.749737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:13.751830 (+ 2093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:13.751846 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:13.753206 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:13.753214 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:13.753520 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:13.754480 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:42:13.754515 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:42:13.757521 (+ 3006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:42:13.762138 (+ 4617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:42:13.762147 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:42:13.762166 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:42:13.762649 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:42:13.763089 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:42:13.763094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:42:13.763097 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:42:13.763447 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:42:13.764149 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:42:13.764161 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:42:13.764669 (+ 508us) client_negotiation.cc:769] Sending connection context
0811 12:42:13.765051 (+ 382us) client_negotiation.cc:240] Negotiation successful
0811 12:42:13.765679 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"thread_start_us":412,"threads_started":1}
I20260811 12:42:13.769052 14407 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40713
I20260811 12:42:13.769444 14407 heartbeater.cc:464] Registering TS with master...
I20260811 12:42:13.770382 14407 heartbeater.cc:511] Master 127.0.186.126:40713 requested a full tablet report, sending...
I20260811 12:42:13.772364 13979 ts_manager.cc:194] Registered new tserver with Master: 2adc693a8cb74ce4990789ef3fea6bfc (127.0.186.66:45287)
I20260811 12:42:13.773725 13979 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:60201
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:42:13.829541 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:58271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40713
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:42:13.879617 14241 heartbeater.cc:503] Master 127.0.186.126:40713 was elected leader, sending a full tablet report...
W20260811 12:42:14.233348 14414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:42:14.233757 14414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:42:14.233960 14414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:42:14.246829 14414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:42:14.247088 14414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:42:14.247345 14414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:42:14.265816 14414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.0.186.84:58271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:40713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:42:14.267786 14414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:42:14.269963 14414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:42:14.289883 14419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:42:14.290622 14420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:42:14.293020 14414 server_base.cc:1034] running on GCE node
W20260811 12:42:14.294099 14422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:42:14.294993 14414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:42:14.296247 14414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:42:14.297523 14414 hybrid_clock.cc:648] HybridClock initialized: now 1786452134297471 us; error 45 us; skew 500 ppm
I20260811 12:42:14.297886 14414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:42:14 dist-test-slave-qg60 krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:42:14.301657 14414 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:42:14.303417 14414 webserver.cc:460] Webserver started at http://127.0.186.67:39757/ using document root <none> and password file <none>
I20260811 12:42:14.304164 14414 fs_manager.cc:359] Metadata directory not provided
I20260811 12:42:14.304301 14414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:42:14.304661 14414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:42:14 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:14.320902 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "31a6cff0af144207855a2302fa1f82cc"
format_stamp: "Formatted at 2026-08-11 12:42:14 on dist-test-slave-qg60"
server_key: "bfd50b02aadcaef089af598480ad8a13"
server_key_iv: "104997e9b6633eb9748a0033dd6993fa"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:14.322070 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "31a6cff0af144207855a2302fa1f82cc"
format_stamp: "Formatted at 2026-08-11 12:42:14 on dist-test-slave-qg60"
server_key: "bfd50b02aadcaef089af598480ad8a13"
server_key_iv: "104997e9b6633eb9748a0033dd6993fa"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:14.328527 14414 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 12:42:14.345209 14433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:14.347287 14414 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260811 12:42:14.347503 14414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "31a6cff0af144207855a2302fa1f82cc"
format_stamp: "Formatted at 2026-08-11 12:42:14 on dist-test-slave-qg60"
server_key: "bfd50b02aadcaef089af598480ad8a13"
server_key_iv: "104997e9b6633eb9748a0033dd6993fa"
server_key_version: "kuduclusterkey@0"
I20260811 12:42:14.347790 14414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:42:14.367599 14414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:42:14.371676 14414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:42:14.372016 14414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:42:14.373214 14414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:42:14.374717 14414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:42:14.374794 14414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:14.374965 14414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:42:14.375020 14414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:42:14.414083 14414 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:41969
I20260811 12:42:14.414160 14561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:41969 every 8 connection(s)
I20260811 12:42:14.415688 14414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:42:14.417569 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 14414
I20260811 12:42:14.417780 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:42:14.418552 745 external_mini_cluster.cc:1428] Setting key 95ff212880f684daa38573aeaa87a039
Aug 11 12:42:14 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:42:14.440192 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.419148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:38759 (local address 127.0.186.126:40713)
0811 12:42:14.419789 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.419796 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.423627 (+ 3831us) server_negotiation.cc:407] Connection header received
0811 12:42:14.423689 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.423692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.423772 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.423857 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:14.425506 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.426300 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.427998 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.428491 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.428605 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.432368 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:14.432373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:14.432377 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:14.432421 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:14.436424 (+ 4003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.437429 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.437439 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.437442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.437667 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.438195 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.438201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.438205 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.438619 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:14.438804 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.439673 (+ 869us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.439880 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":376,"threads_started":1}
I20260811 12:42:14.441339 14565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.419673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:40713 (local address 127.0.186.67:38759)
0811 12:42:14.420889 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:14.420955 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:14.423328 (+ 2373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:14.424110 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:14.424119 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:14.424605 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:42:14.425327 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.425348 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.426438 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.426441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.427844 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.427856 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.428714 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.428719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.429009 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.429753 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:42:14.429775 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:42:14.432095 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:42:14.436606 (+ 4511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:42:14.436625 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:42:14.436642 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:42:14.437265 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:42:14.437798 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:42:14.437807 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:42:14.437811 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:42:14.438051 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:42:14.438851 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:42:14.438858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:42:14.439282 (+ 424us) client_negotiation.cc:769] Sending connection context
0811 12:42:14.439548 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 12:42:14.439987 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":412,"threads_started":1}
I20260811 12:42:14.443049 14562 heartbeater.cc:347] Connected to a master server at 127.0.186.126:40713
I20260811 12:42:14.443405 14562 heartbeater.cc:464] Registering TS with master...
I20260811 12:42:14.444212 14562 heartbeater.cc:511] Master 127.0.186.126:40713 requested a full tablet report, sending...
I20260811 12:42:14.446205 13979 ts_manager.cc:194] Registered new tserver with Master: 31a6cff0af144207855a2302fa1f82cc (127.0.186.67:41969)
I20260811 12:42:14.447362 13979 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:38759
I20260811 12:42:14.449039 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:42:14.469830 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.454687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57374 (local address 127.0.186.126:40713)
0811 12:42:14.454890 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.454895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.455418 (+ 523us) server_negotiation.cc:407] Connection header received
0811 12:42:14.455582 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.455586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.455677 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.455782 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:14.457685 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.458449 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.460183 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.460659 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.460937 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.463934 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:14.463939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:14.463943 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:14.463987 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:14.466749 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.467594 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.467599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.467601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.467748 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.468260 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.468264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.468267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.468604 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:14.468986 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.469390 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.469591 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 12:42:14.474561 13979 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:42:14.486038 13979 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:42:14.533064 14583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.511360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:45287 (local address 127.0.0.1:42982)
0811 12:42:14.523579 (+ 12219us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:14.523610 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:14.523814 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:14.524920 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:14.524932 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:14.524980 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:42:14.525729 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.525742 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.527729 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.527734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.529755 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.529766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.531906 (+ 2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.531914 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.532163 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.532222 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 12:42:14.532383 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 12:42:14.532579 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11993,"mutex_wait_us":1,"thread_start_us":13835,"threads_started":1}
I20260811 12:42:14.534152 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.511073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:41969 (local address 127.0.0.1:47392)
0811 12:42:14.514668 (+ 3595us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:14.516504 (+ 1836us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:14.516782 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:14.527663 (+ 10881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:14.527670 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:14.527706 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:42:14.528210 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.528221 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.529885 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.529892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.531364 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.531382 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.533277 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.533284 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.533523 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.533561 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 12:42:14.533636 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 12:42:14.533778 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3143,"thread_start_us":2908,"threads_started":1}
I20260811 12:42:14.534648 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.511842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.0.186.66:45287)
0811 12:42:14.513187 (+ 1345us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.513198 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.523774 (+ 10576us) server_negotiation.cc:407] Connection header received
0811 12:42:14.524126 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.524139 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.524575 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.524909 (+ 334us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:42:14.525947 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.527609 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.529932 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.531657 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.531820 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.532062 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.532444 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.532630 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":972,"thread_start_us":790,"threads_started":1}
I20260811 12:42:14.535156 14582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.512763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47392 (local address 127.0.186.67:41969)
0811 12:42:14.526378 (+ 13615us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.526385 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.526414 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:42:14.526491 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.526496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.526806 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.527026 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:42:14.528399 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.529648 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.531593 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.532999 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.534066 (+ 1067us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.534429 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.534516 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.534699 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13455,"thread_start_us":13278,"threads_started":1}
I20260811 12:42:14.537176 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.515314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43425 (local address 127.0.0.1:38416)
0811 12:42:14.524634 (+ 9320us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:14.524663 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:14.526056 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:14.527500 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:14.527505 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:14.527541 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:42:14.529142 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.529154 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.531353 (+ 2199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.531358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.533414 (+ 2056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.533431 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.536285 (+ 2854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.536292 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.536498 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.536540 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 12:42:14.536649 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 12:42:14.536816 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9156,"thread_start_us":8623,"threads_started":1}
I20260811 12:42:14.537293 14584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.515779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38416 (local address 127.0.186.65:43425)
0811 12:42:14.526835 (+ 11056us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.526843 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.526872 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:42:14.526967 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.526974 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.527197 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.527380 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:42:14.529360 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.531175 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.533639 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.536009 (+ 2370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.536209 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.536454 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.536713 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.536923 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10871,"thread_start_us":9865,"threads_started":1}
I20260811 12:42:14.539885 14332 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6a2118b8c747b1aa25fa2e10bea99a (DEFAULT_TABLE table=test-table [id=ac52fa65578940d78a857e836bbac5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:42:14.539885 14486 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6a2118b8c747b1aa25fa2e10bea99a (DEFAULT_TABLE table=test-table [id=ac52fa65578940d78a857e836bbac5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:42:14.542503 14332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6a2118b8c747b1aa25fa2e10bea99a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:42:14.543208 14486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6a2118b8c747b1aa25fa2e10bea99a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:42:14.543728 14160 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6a2118b8c747b1aa25fa2e10bea99a (DEFAULT_TABLE table=test-table [id=ac52fa65578940d78a857e836bbac5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:42:14.545195 14160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6a2118b8c747b1aa25fa2e10bea99a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:42:14.558605 14585 tablet_bootstrap.cc:492] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Bootstrap starting.
I20260811 12:42:14.562258 14587 tablet_bootstrap.cc:492] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Bootstrap starting.
I20260811 12:42:14.565258 14586 tablet_bootstrap.cc:492] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Bootstrap starting.
I20260811 12:42:14.566166 14585 tablet_bootstrap.cc:654] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Neither blocks nor log segments found. Creating new log.
I20260811 12:42:14.567569 14587 tablet_bootstrap.cc:654] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Neither blocks nor log segments found. Creating new log.
I20260811 12:42:14.567778 14585 log.cc:824] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Log is configured to *not* fsync() on all Append() calls
I20260811 12:42:14.568567 14586 tablet_bootstrap.cc:654] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Neither blocks nor log segments found. Creating new log.
I20260811 12:42:14.569072 14587 log.cc:824] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Log is configured to *not* fsync() on all Append() calls
I20260811 12:42:14.569953 14586 log.cc:824] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Log is configured to *not* fsync() on all Append() calls
I20260811 12:42:14.571786 14585 tablet_bootstrap.cc:492] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: No bootstrap required, opened a new log
I20260811 12:42:14.572178 14585 ts_tablet_manager.cc:1397] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260811 12:42:14.572829 14587 tablet_bootstrap.cc:492] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: No bootstrap required, opened a new log
I20260811 12:42:14.573140 14587 ts_tablet_manager.cc:1397] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260811 12:42:14.573616 14586 tablet_bootstrap.cc:492] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: No bootstrap required, opened a new log
I20260811 12:42:14.573875 14586 ts_tablet_manager.cc:1397] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 12:42:14.582154 14586 raft_consensus.cc:348] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.582612 14586 raft_consensus.cc:374] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:42:14.582710 14586 raft_consensus.cc:729] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2adc693a8cb74ce4990789ef3fea6bfc, State: Initialized, Role: FOLLOWER
I20260811 12:42:14.583622 14586 consensus_queue.cc:260] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.584882 14407 heartbeater.cc:503] Master 127.0.186.126:40713 was elected leader, sending a full tablet report...
I20260811 12:42:14.584988 14585 raft_consensus.cc:348] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.585493 14585 raft_consensus.cc:374] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:42:14.585588 14585 raft_consensus.cc:729] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5db7ebab6140148218305dd74d8bf3, State: Initialized, Role: FOLLOWER
I20260811 12:42:14.585350 14587 raft_consensus.cc:348] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.585671 14586 ts_tablet_manager.cc:1428] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 12:42:14.585798 14587 raft_consensus.cc:374] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:42:14.585899 14587 raft_consensus.cc:729] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a6cff0af144207855a2302fa1f82cc, State: Initialized, Role: FOLLOWER
I20260811 12:42:14.586370 14585 consensus_queue.cc:260] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.586611 14587 consensus_queue.cc:260] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.587862 14562 heartbeater.cc:503] Master 127.0.186.126:40713 was elected leader, sending a full tablet report...
I20260811 12:42:14.591025 14585 ts_tablet_manager.cc:1428] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Time spent starting tablet: real 0.019s user 0.017s sys 0.003s
I20260811 12:42:14.592386 14587 ts_tablet_manager.cc:1428] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Time spent starting tablet: real 0.019s user 0.011s sys 0.004s
W20260811 12:42:14.667613 14563 tablet.cc:2369] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:42:14.671088 14591 raft_consensus.cc:482] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:42:14.671363 14591 raft_consensus.cc:504] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.673231 14591 leader_election.cc:288] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a6cff0af144207855a2302fa1f82cc (127.0.186.67:41969), 1a5db7ebab6140148218305dd74d8bf3 (127.0.186.65:43425)
I20260811 12:42:14.681356 14582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.673671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:50215 (local address 127.0.186.67:41969)
0811 12:42:14.673877 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.673884 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.674402 (+ 518us) server_negotiation.cc:407] Connection header received
0811 12:42:14.674782 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.674792 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.674899 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.674980 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:42:14.675839 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.677205 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.679200 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.680118 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.680301 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.680381 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.680921 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.681080 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:42:14.681440 14595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.673451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:41969 (local address 127.0.186.66:50215)
0811 12:42:14.674289 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:14.674309 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:14.674553 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:14.675211 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:14.675224 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:14.675247 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:42:14.675670 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.675683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.677360 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.677365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.679022 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.679035 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.680523 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.680529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.680712 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.680771 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 12:42:14.680866 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 12:42:14.681024 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":477,"threads_started":1}
I20260811 12:42:14.682335 14584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.674624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:48635 (local address 127.0.186.65:43425)
0811 12:42:14.674808 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.674813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.675518 (+ 705us) server_negotiation.cc:407] Connection header received
0811 12:42:14.675686 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.675692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.675782 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.675881 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:42:14.676434 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.677251 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.679970 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.681119 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.681274 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.681341 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.681956 (+ 615us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.682086 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:42:14.682372 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.674383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43425 (local address 127.0.186.66:48635)
0811 12:42:14.675376 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0811 12:42:14.675394 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 12:42:14.675538 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:42:14.675906 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:42:14.675910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:42:14.675940 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:42:14.676276 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.676285 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.677436 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.677442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.679784 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:42:14.679800 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.681538 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.681546 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:42:14.681765 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.681807 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 12:42:14.681920 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 12:42:14.682052 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":630,"threads_started":1}
I20260811 12:42:14.682659 14507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6a2118b8c747b1aa25fa2e10bea99a" candidate_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a6cff0af144207855a2302fa1f82cc" is_pre_election: true
I20260811 12:42:14.683221 14507 raft_consensus.cc:2454] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2adc693a8cb74ce4990789ef3fea6bfc in term 0.
I20260811 12:42:14.683421 14184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6a2118b8c747b1aa25fa2e10bea99a" candidate_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5db7ebab6140148218305dd74d8bf3" is_pre_election: true
I20260811 12:42:14.684005 14184 raft_consensus.cc:2454] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2adc693a8cb74ce4990789ef3fea6bfc in term 0.
I20260811 12:42:14.683974 14276 leader_election.cc:302] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2adc693a8cb74ce4990789ef3fea6bfc, 31a6cff0af144207855a2302fa1f82cc; no voters:
I20260811 12:42:14.684434 14591 raft_consensus.cc:2781] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:42:14.684598 14591 raft_consensus.cc:482] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:42:14.684712 14591 raft_consensus.cc:3037] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:42:14.688042 14591 raft_consensus.cc:504] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.688817 14591 leader_election.cc:288] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [CANDIDATE]: Term 1 election: Requested vote from peers 31a6cff0af144207855a2302fa1f82cc (127.0.186.67:41969), 1a5db7ebab6140148218305dd74d8bf3 (127.0.186.65:43425)
I20260811 12:42:14.689531 14184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6a2118b8c747b1aa25fa2e10bea99a" candidate_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5db7ebab6140148218305dd74d8bf3"
I20260811 12:42:14.689524 14507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6a2118b8c747b1aa25fa2e10bea99a" candidate_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a6cff0af144207855a2302fa1f82cc"
I20260811 12:42:14.689754 14184 raft_consensus.cc:3037] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:42:14.689754 14507 raft_consensus.cc:3037] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:42:14.693114 14184 raft_consensus.cc:2454] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2adc693a8cb74ce4990789ef3fea6bfc in term 1.
I20260811 12:42:14.693114 14507 raft_consensus.cc:2454] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2adc693a8cb74ce4990789ef3fea6bfc in term 1.
I20260811 12:42:14.693552 14276 leader_election.cc:302] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2adc693a8cb74ce4990789ef3fea6bfc, 31a6cff0af144207855a2302fa1f82cc; no voters:
I20260811 12:42:14.693892 14591 raft_consensus.cc:2781] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:42:14.694377 14591 raft_consensus.cc:686] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 1 LEADER]: Becoming Leader. State: Replica: 2adc693a8cb74ce4990789ef3fea6bfc, State: Running, Role: LEADER
I20260811 12:42:14.694938 14591 consensus_queue.cc:237] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } }
I20260811 12:42:14.700650 13979 catalog_manager.cc:5495] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 2adc693a8cb74ce4990789ef3fea6bfc (127.0.186.66). New cstate: current_term: 1 leader_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2adc693a8cb74ce4990789ef3fea6bfc" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 } health_report { overall_health: UNKNOWN } } }
I20260811 12:42:14.720121 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.713578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42990 (local address 127.0.186.66:45287)
0811 12:42:14.713819 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.713827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.713907 (+ 80us) server_negotiation.cc:407] Connection header received
0811 12:42:14.714210 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.714214 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.714296 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.714435 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:42:14.714878 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.715835 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.717568 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.718090 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.718201 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.718739 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:42:14.719349 (+ 610us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:42:14.719503 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.719626 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.719701 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:42:14.729607 14184 raft_consensus.cc:1261] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 1 FOLLOWER]: Refusing update from remote peer 2adc693a8cb74ce4990789ef3fea6bfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:42:14.729607 14507 raft_consensus.cc:1261] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 1 FOLLOWER]: Refusing update from remote peer 2adc693a8cb74ce4990789ef3fea6bfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:42:14.730851 14597 consensus_queue.cc:1035] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a6cff0af144207855a2302fa1f82cc" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:42:14.731302 14591 consensus_queue.cc:1035] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5db7ebab6140148218305dd74d8bf3" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 12:42:14.740991 14408 tablet.cc:2369] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:42:14.762760 14601 mvcc.cc:205] Tried to move back new op lower bound from 7317307943839936512 to 7317307943715405824. Current Snapshot: MvccSnapshot[applied={T|T < 7317307943839936512}]
I20260811 12:42:14.773545 13978 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:42:14.773945 13978 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:42:14.778505 13978 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87e95fecf3cf4fb7bb7e1c4d0edbcf3e: Sending DeleteTablet for 3 replicas of tablet 1c6a2118b8c747b1aa25fa2e10bea99a
I20260811 12:42:14.779799 14332 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c6a2118b8c747b1aa25fa2e10bea99a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:42:14 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:42982
I20260811 12:42:14.780021 14486 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c6a2118b8c747b1aa25fa2e10bea99a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:42:14 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:47392
I20260811 12:42:14.780239 14160 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c6a2118b8c747b1aa25fa2e10bea99a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:42:14 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:38416
I20260811 12:42:14.782205 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 14078
I20260811 12:42:14.791191 14614 tablet_replica.cc:330] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: stopping tablet replica
I20260811 12:42:14.792913 14614 raft_consensus.cc:2229] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:42:14.794631 14614 raft_consensus.cc:2258] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:42:14.798415 14614 ts_tablet_manager.cc:1905] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:42:14.798800 14613 tablet_replica.cc:330] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: stopping tablet replica
I20260811 12:42:14.799372 14613 raft_consensus.cc:2229] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:42:14.800055 14613 raft_consensus.cc:2258] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:42:14.810130 14614 ts_tablet_manager.cc:1918] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 11 12:42:14 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:42:14.810334 14614 log.cc:1196] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/1c6a2118b8c747b1aa25fa2e10bea99a
I20260811 12:42:14.810889 14614 ts_tablet_manager.cc:1939] T 1c6a2118b8c747b1aa25fa2e10bea99a P 1a5db7ebab6140148218305dd74d8bf3: Deleting consensus metadata
I20260811 12:42:14.811451 14611 tablet_replica.cc:330] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: stopping tablet replica
I20260811 12:42:14.812086 14611 raft_consensus.cc:2229] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:42:14.812601 14613 ts_tablet_manager.cc:1905] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:42:14.812975 13959 catalog_manager.cc:4841] TS 1a5db7ebab6140148218305dd74d8bf3 (127.0.186.65:43425): tablet 1c6a2118b8c747b1aa25fa2e10bea99a (table test-table [id=ac52fa65578940d78a857e836bbac5cd]) successfully deleted
I20260811 12:42:14.813514 14611 raft_consensus.cc:2258] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:42:14.817104 14611 ts_tablet_manager.cc:1905] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:42:14.824885 14584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.786245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38426 (local address 127.0.186.65:43425)
0811 12:42:14.786496 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.786506 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.797564 (+ 11058us) server_negotiation.cc:407] Connection header received
0811 12:42:14.798226 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.798235 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.798354 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.798452 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:14.800685 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.802018 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.804335 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.805231 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.805358 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.814973 (+ 9615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:14.814989 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:14.815006 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:14.815060 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:14.819746 (+ 4686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.820925 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.820935 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.820951 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.821209 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.821719 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.821724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.821728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.822379 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:14.822731 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.824127 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.824412 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 12:42:14.826176 14235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:42:14.826443 14611 ts_tablet_manager.cc:1918] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:42:14.826687 14611 log.cc:1196] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/1c6a2118b8c747b1aa25fa2e10bea99a
I20260811 12:42:14.827337 14611 ts_tablet_manager.cc:1939] T 1c6a2118b8c747b1aa25fa2e10bea99a P 2adc693a8cb74ce4990789ef3fea6bfc: Deleting consensus metadata
I20260811 12:42:14.829463 13957 catalog_manager.cc:4841] TS 2adc693a8cb74ce4990789ef3fea6bfc (127.0.186.66:45287): tablet 1c6a2118b8c747b1aa25fa2e10bea99a (table test-table [id=ac52fa65578940d78a857e836bbac5cd]) successfully deleted
I20260811 12:42:14.829777 14613 ts_tablet_manager.cc:1918] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:42:14.829990 14613 log.cc:1196] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/1c6a2118b8c747b1aa25fa2e10bea99a
I20260811 12:42:14.830669 14613 ts_tablet_manager.cc:1939] T 1c6a2118b8c747b1aa25fa2e10bea99a P 31a6cff0af144207855a2302fa1f82cc: Deleting consensus metadata
I20260811 12:42:14.833168 13959 catalog_manager.cc:4841] TS 31a6cff0af144207855a2302fa1f82cc (127.0.186.67:41969): tablet 1c6a2118b8c747b1aa25fa2e10bea99a (table test-table [id=ac52fa65578940d78a857e836bbac5cd]) successfully deleted
I20260811 12:42:14.927976 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 14078
I20260811 12:42:14.951514 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 14248
Aug 11 12:42:14 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:42:14.969863 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:14.952551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42994 (local address 127.0.186.66:45287)
0811 12:42:14.952826 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:14.952832 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:14.952855 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:42:14.952934 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:14.952939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:14.953036 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:14.953175 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:14.954591 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.955483 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.956968 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:14.957683 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:14.957827 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:14.962470 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:14.962491 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:14.962520 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:14.962568 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:14.966751 (+ 4183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.967519 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.967529 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.967533 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.967716 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:14.968123 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:14.968128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:14.968132 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:14.968613 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:14.969022 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:14.969214 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 12:42:14.969462 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:42:14.970758 14402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:42:15.090449 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 14248
I20260811 12:42:15.114845 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 14414
Aug 11 12:42:15 dist-test-slave-qg60 krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:42:15.130692 14582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:42:15.115850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47408 (local address 127.0.186.67:41969)
0811 12:42:15.116044 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 12:42:15.116049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:42:15.116068 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:42:15.116128 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:42:15.116132 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:42:15.116196 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:42:15.116287 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:42:15.117838 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:15.118561 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:15.119792 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:42:15.120255 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:42:15.120356 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:42:15.125117 (+ 4761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:42:15.125132 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:42:15.125149 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:42:15.125191 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:42:15.127966 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:15.128619 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:15.128627 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:15.128630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:15.128851 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:42:15.129290 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:42:15.129293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:42:15.129295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:42:15.129690 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:42:15.129913 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 12:42:15.130227 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 12:42:15.130401 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:42:15.131485 14556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:42:15.225934 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 14414
I20260811 12:42:15.248937 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 13941
I20260811 12:42:15.250332 14015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:42:15.373482 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 13941
I20260811 12:42:15.406186 745 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 12:42:15.752310 745 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 12:42:15.752661 745 mini_ranger.cc:66] Stopping Ranger...
I20260811 12:42:16.109179 745 mini_ranger.cc:68] Stopped Ranger
2026-08-11 12:42:16.109 UTC [13459] LOG: received smart shutdown request
2026-08-11 12:42:16.115 UTC [13459] LOG: background worker "logical replication launcher" (PID 13469) exited with exit code 1
2026-08-11 12:42:16.115 UTC [13464] LOG: shutting down
2026-08-11 12:42:16.321 UTC [13459] LOG: database system is shut down
2026-08-11T12:42:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54403 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:42:16 dist-test-slave-qg60 krb5kdc[14631](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:42:16 dist-test-slave-qg60 krb5kdc[14631](info): set up 2 sockets
Aug 11 12:42:16 dist-test-slave-qg60 krb5kdc[14631](info): commencing operation
krb5kdc: starting...
W20260811 12:42:17.697775 745 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:42:17 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:42:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:42:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/rangeradmin_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/rangeradmin_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/rangerlookup_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/rangerlookup_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
I20260811 12:42:18.184978 745 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVJER3t/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/postgres -l logfile start
2026-08-11 12:42:20.943 UTC [14664] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 12:42:20.943 UTC [14664] LOG: listening on IPv4 address "127.0.186.84", port 45993
2026-08-11 12:42:20.947 UTC [14664] LOG: listening on Unix socket "/tmp/.s.PGSQL.45993"
2026-08-11 12:42:20.970 UTC [14667] LOG: database system was shut down at 2026-08-11 12:42:19 UTC
2026-08-11 12:42:20.974 UTC [14664] LOG: database system is ready to accept connections
I20260811 12:42:22.049451 745 mini_postgres.cc:96] Postgres bound to 45993
2026-08-11 12:42:22.078 UTC [14676] FATAL: database "slave" does not exist
127.0.186.84:45993 - accepting connections
I20260811 12:42:22.078783 745 mini_ranger.cc:161] Starting Ranger...
I20260811 12:42:22.115180 745 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 12:42:22.696329 745 mini_ranger.cc:87] Created ranger Postgres database
I20260811 12:42:22.696498 745 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-admin
2026-08-11 12:42:23,015 [I] DB FLAVOR :POSTGRES
2026-08-11 12:42:23,015 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 12:42:23,015 [I] Checking connection..
2026-08-11 12:42:23,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 12:42:23,279 [I] Checking connection passed.
2026-08-11 12:42:23,279 [I] --------- Verifying version history table ---------
2026-08-11 12:42:23,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 12:42:23,559 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 12:42:23,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 12:42:23,825 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 12:42:23,825 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 12:42:23,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 12:42:24.072 UTC [14746] WARNING: there is no transaction in progress
2026-08-11 12:42:24,080 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 12:42:24,081 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 12:42:24,371 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 12:42:24,371 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 12:42:24,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 12:42:24,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 12:42:24,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-11 12:42:25,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 12:42:25,395 [I] Table x_portal_user does not exist in database ranger
2026-08-11 12:42:25,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 12:42:25,662 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 12:42:25,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 12:42:25,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 12:42:26,176 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 12:42:26,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 12:42:27.230 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.248 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.267 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.284 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.305 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.327 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.394 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.403 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.420 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.432 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.444 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.462 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.473 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.480 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.488 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:27.498 UTC [14875] WARNING: there is no transaction in progress
2026-08-11 12:42:28,292 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 12:42:28,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 12:42:28,582 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 12:42:28,583 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 12:42:28,858 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 12:42:28,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 12:42:29,132 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 12:42:29,133 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 12:42:29,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 12:42:29,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-11 12:42:29,917 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 12:42:29,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 12:42:30,192 [I] DB_PATCHES have already been applied
I20260811 12:42:30.198661 745 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVJER3t/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 12:42:30.198783 745 mini_ranger.cc:193] Using host: 127.0.186.84
I20260811 12:42:30.224176 745 mini_ranger.cc:227] Ranger admin URL: http://127.0.186.84:33321
Aug 11, 2026 12:42:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:42:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:42:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 12:42:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 12:42:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 12:42:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 12:42:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 12:42:31.514986 745 mini_ranger.cc:160] Time spent starting Ranger: real 9.436s user 0.000s sys 0.078s
Aug 11, 2026 12:42:53 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 12:42:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 12:42:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 12:42:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 12:42:54 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 12:42:55.568495 745 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.0.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.0.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/rangerkms_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.0.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/rangerkms_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.186.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.0.186.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.186.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/HTTP_127.0.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 12:42:55 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452175, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 12:42:55.821376 745 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 12:42:55.853979 745 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 12:42:56.881677 745 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 12:42:56.881798 745 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms
I20260811 12:42:56.881865 745 mini_ranger_kms.cc:227] Using postgres at 127.0.186.84:45993
2026-08-11 12:42:57,301 [I] DB FLAVOR :POSTGRES
2026-08-11 12:42:57,302 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 12:42:57,302 [I] Checking connection
2026-08-11 12:42:57,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 12:42:57,557 [I] connection success
2026-08-11 12:42:57,558 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 12:42:57,558 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 12:42:57,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 12:42:57,810 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 12:42:57,810 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 12:42:57,810 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 12:42:57,810 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.186.84:45993/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 12:42:58,083 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 12:42:58.619330 745 mini_ranger_kms.cc:310] Created kms service
I20260811 12:42:58.864450 745 mini_ranger_kms.cc:326] Created kudu user
I20260811 12:42:58.916488 745 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 12:42:58 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452175, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:42:59.368588 745 mini_ranger_kms.cc:384] Added ranger policy
I20260811 12:42:59.368971 745 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVJER3t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVJER3t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 12:42:59.369021 745 mini_ranger_kms.cc:240] Using host: 127.0.186.84
I20260811 12:42:59.400579 745 mini_ranger_kms.cc:276] Ranger KMS PID: 15095
I20260811 12:42:59.400733 745 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.0.186.84:48399
Aug 11, 2026 12:43:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:43:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:43:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 12:43:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 12:43:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 12:43:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 12:43:01 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786452181, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.186.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:01.934919 745 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.114s user 0.079s sys 0.391s
I20260811 12:43:01.935182 745 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 12:43:01.935374 745 mini_ranger_kms.cc:401] 127.0.186.84:48399/kms/v1/keys
Aug 11 12:43:02 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452181, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.186.84@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
Aug 11 12:43:02 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452181, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.186.84@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
Aug 11 12:43:05 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:43:05.304885 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:44193
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:44193
--ranger_config_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:05.680312 15152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:05.680681 15152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:05.680872 15152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:05.688609 15152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:05.688795 15152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:05.688918 15152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:05.689021 15152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:05.689108 15152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:05.699671 15152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
--ranger_kms_url=127.0.186.84:48399/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:44193
--ranger_config_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:44193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:05.701227 15152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:05.702725 15152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:05.716118 15165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:05.716300 15158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:05.716248 15163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:05.716647 15152 server_base.cc:1034] running on GCE node
I20260811 12:43:05.717720 15152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:05.719153 15152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:05.720398 15152 hybrid_clock.cc:648] HybridClock initialized: now 1786452185720350 us; error 32 us; skew 500 ppm
I20260811 12:43:05.720891 15152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:05 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:05.724160 15152 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:05.725845 15152 webserver.cc:460] Webserver started at http://127.0.186.126:33345/ using document root <none> and password file <none>
I20260811 12:43:05.726526 15152 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:05.726675 15152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:05.727015 15152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:43:05 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:05.790956 15152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "4466f05a910b46d28ce523f90e90bddd"
format_stamp: "Formatted at 2026-08-11 12:43:05 on dist-test-slave-qg60"
server_key: "a905c7f46cb81abd7a51ca1d2c1f5136"
server_key_iv: "d9e070d360b1022255f505e868cdd06a"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:05.791898 15152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "4466f05a910b46d28ce523f90e90bddd"
format_stamp: "Formatted at 2026-08-11 12:43:05 on dist-test-slave-qg60"
server_key: "a905c7f46cb81abd7a51ca1d2c1f5136"
server_key_iv: "d9e070d360b1022255f505e868cdd06a"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:05.797719 15152 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 12:43:05.815879 15174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:05.817596 15152 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260811 12:43:05.817864 15152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "4466f05a910b46d28ce523f90e90bddd"
format_stamp: "Formatted at 2026-08-11 12:43:05 on dist-test-slave-qg60"
server_key: "a905c7f46cb81abd7a51ca1d2c1f5136"
server_key_iv: "d9e070d360b1022255f505e868cdd06a"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:05.818114 15152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:05.830152 15152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:05.834908 15152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:05.835276 15152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:05.856153 15152 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:44193
I20260811 12:43:05.856178 15233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:44193 every 8 connection(s)
I20260811 12:43:05.857740 15152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:05.861963 15234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:05.862071 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 15152
I20260811 12:43:05.862310 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:43:05.863233 745 external_mini_cluster.cc:1428] Setting key 832fedde46923097507be03706357b1c
I20260811 12:43:05.877108 15234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Bootstrap starting.
Aug 11 12:43:05 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:05.880937 15234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:05.882074 15234 log.cc:824] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:05.885819 15234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: No bootstrap required, opened a new log
I20260811 12:43:05.888833 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:05.865531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33182 (local address 127.0.186.126:44193)
0811 12:43:05.866391 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:05.866404 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:05.866444 (+ 40us) server_negotiation.cc:407] Connection header received
0811 12:43:05.868621 (+ 2177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:05.868646 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:05.869205 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:05.869565 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:05.871308 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:05.872672 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:05.874648 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:05.875351 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:05.875496 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:05.880320 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:05.880328 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:05.880343 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:05.880387 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:05.883970 (+ 3583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:05.884755 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:05.884765 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:05.884773 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:05.884982 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:05.885404 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:05.885411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:05.885415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:05.886150 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:05.886480 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:05.886854 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 12:43:05.887286 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":418,"threads_started":1}
I20260811 12:43:05.895440 15234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:05.895790 15234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:05.895864 15234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466f05a910b46d28ce523f90e90bddd, State: Initialized, Role: FOLLOWER
I20260811 12:43:05.896365 15234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:05.896574 15234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:05.896674 15234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:05.896876 15234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:05.899096 15234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:05.899561 15234 leader_election.cc:302] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4466f05a910b46d28ce523f90e90bddd; no voters:
I20260811 12:43:05.900272 15234 leader_election.cc:288] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:43:05.900413 15240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:05.901114 15240 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 LEADER]: Becoming Leader. State: Replica: 4466f05a910b46d28ce523f90e90bddd, State: Running, Role: LEADER
I20260811 12:43:05.901791 15240 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:05.902729 15234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:05.905435 15241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4466f05a910b46d28ce523f90e90bddd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } } }
I20260811 12:43:05.906059 15241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:05.906854 15243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4466f05a910b46d28ce523f90e90bddd. Latest consensus state: current_term: 1 leader_uuid: "4466f05a910b46d28ce523f90e90bddd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } } }
I20260811 12:43:05.907508 15243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:05.913364 15247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:05.913648 15234 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 12:43:05.928370 15247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:05.940948 15247 catalog_manager.cc:1347] Generated new cluster ID: ee8a6854accd4f6f8446b6d1bd291b64
I20260811 12:43:05.941069 15247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:05.967300 15247 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:43:05.969563 15247 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:05.981439 15247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Generated new TSK 0
I20260811 12:43:05.982861 15247 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:43:06.742282 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:44193
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:43:07 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786452187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 12:43:07.238860 15288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:07.239343 15288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:07.239578 15288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:07.251519 15288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:07.251706 15288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:07.251981 15288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:43:07.268528 15288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.0.186.84:48399/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:07.270624 15288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:07.272526 15288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:07.291438 15299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:07.292943 15300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:07.300431 15302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:07.306660 15288 server_base.cc:1034] running on GCE node
I20260811 12:43:07.307509 15288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:07.309023 15288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:07.310367 15288 hybrid_clock.cc:648] HybridClock initialized: now 1786452187310242 us; error 108 us; skew 500 ppm
I20260811 12:43:07.310859 15288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:07 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:07.315416 15288 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:43:07.318437 15288 webserver.cc:460] Webserver started at http://127.0.186.65:43991/ using document root <none> and password file <none>
I20260811 12:43:07.319492 15288 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:07.319700 15288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:07.320101 15288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:43:07 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:07.340011 15288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "c43e0fd3d20c40099da0d9272f04b908"
format_stamp: "Formatted at 2026-08-11 12:43:07 on dist-test-slave-qg60"
server_key: "b0730f73ab2a26ac22af8f75fa053f0e"
server_key_iv: "42d1fb719ae74c4d509e5494202a6f58"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:07.341104 15288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "c43e0fd3d20c40099da0d9272f04b908"
format_stamp: "Formatted at 2026-08-11 12:43:07 on dist-test-slave-qg60"
server_key: "b0730f73ab2a26ac22af8f75fa053f0e"
server_key_iv: "42d1fb719ae74c4d509e5494202a6f58"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:07.359476 15288 fs_manager.cc:691] Time spent creating directory manager: real 0.018s user 0.001s sys 0.015s
I20260811 12:43:07.389591 15312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:07.391857 15288 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.004s
I20260811 12:43:07.392088 15288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "c43e0fd3d20c40099da0d9272f04b908"
format_stamp: "Formatted at 2026-08-11 12:43:07 on dist-test-slave-qg60"
server_key: "b0730f73ab2a26ac22af8f75fa053f0e"
server_key_iv: "42d1fb719ae74c4d509e5494202a6f58"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:07.392385 15288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:07.428267 15288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:07.434157 15288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:07.434562 15288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:07.436267 15288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:07.438165 15288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:07.438277 15288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:07.438423 15288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:07.438503 15288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:07.497745 15288 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:43609
I20260811 12:43:07.497761 15438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:43609 every 8 connection(s)
I20260811 12:43:07.499805 15288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:43:07.509709 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 15288
I20260811 12:43:07.509950 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:43:07.511083 745 external_mini_cluster.cc:1428] Setting key 9a59255981000c860885a55fd02f1524
Aug 11 12:43:07 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:07.536878 15442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:07.504615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:38935 (local address 127.0.186.126:44193)
0811 12:43:07.517136 (+ 12521us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:07.517142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:07.517165 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:43:07.517228 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:07.517234 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:07.517328 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:07.517445 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:07.519742 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:07.520987 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:07.523323 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:07.523915 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:07.524005 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:07.528621 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:07.528628 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:07.528632 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:07.528674 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:07.532192 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:07.533497 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:07.533503 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:07.533507 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:07.533781 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:07.534515 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:07.534521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:07.534523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:07.534897 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:07.535049 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:07.536191 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0811 12:43:07.536453 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12390,"thread_start_us":12276,"threads_started":1}
I20260811 12:43:07.539340 15441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:07.503839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:44193 (local address 127.0.186.65:38935)
0811 12:43:07.509388 (+ 5549us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:07.509442 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:07.512776 (+ 3334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:07.517999 (+ 5223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:07.518012 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:07.518661 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:07.519501 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:07.519529 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:07.521207 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:07.521212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:07.523161 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:07.523178 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:07.524353 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:07.524359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:07.524653 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:07.525506 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:07.525535 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:07.528298 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:07.532391 (+ 4093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:07.532404 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:07.532425 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:07.533245 (+ 820us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:07.533968 (+ 723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:07.533973 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:07.533977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:07.534312 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:07.535195 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:07.535203 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:07.535698 (+ 495us) client_negotiation.cc:769] Sending connection context
0811 12:43:07.537217 (+ 1519us) client_negotiation.cc:240] Negotiation successful
0811 12:43:07.537839 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5186,"thread_start_us":4909,"threads_started":1}
I20260811 12:43:07.541602 15439 heartbeater.cc:347] Connected to a master server at 127.0.186.126:44193
I20260811 12:43:07.541956 15439 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:07.542920 15439 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:07.545910 15193 ts_manager.cc:194] Registered new tserver with Master: c43e0fd3d20c40099da0d9272f04b908 (127.0.186.65:43609)
I20260811 12:43:07.548050 15193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:38935
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:43:07.601615 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:44193
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:43:07 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
Aug 11 12:43:07 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
W20260811 12:43:08.164894 15445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:08.165464 15445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:08.165688 15445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:08.178509 15445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:08.178781 15445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:08.179095 15445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:43:08.196362 15445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.0.186.84:48399/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:08.198684 15445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:08.200824 15445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:08.240978 15455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:08.242545 15456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:08.253952 15459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:08.254714 15445 server_base.cc:1034] running on GCE node
I20260811 12:43:08.255877 15445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:08.265919 15445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:08.270421 15445 hybrid_clock.cc:648] HybridClock initialized: now 1786452188270270 us; error 137 us; skew 500 ppm
I20260811 12:43:08.271039 15445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:08 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:08.290932 15445 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:43:08.325563 15445 webserver.cc:460] Webserver started at http://127.0.186.66:32873/ using document root <none> and password file <none>
I20260811 12:43:08.326514 15445 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:08.326680 15445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:08.327100 15445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:43:08 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:08.345224 15445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "09bb6c43084f4392979d785c2b8ae2a6"
format_stamp: "Formatted at 2026-08-11 12:43:08 on dist-test-slave-qg60"
server_key: "e5cac9c8f3647e8b888f663387f85c50"
server_key_iv: "d315f86387a9d1fec1ba70f3e8a284b2"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:08.346495 15445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "09bb6c43084f4392979d785c2b8ae2a6"
format_stamp: "Formatted at 2026-08-11 12:43:08 on dist-test-slave-qg60"
server_key: "e5cac9c8f3647e8b888f663387f85c50"
server_key_iv: "d315f86387a9d1fec1ba70f3e8a284b2"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:08.356473 15445 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.009s sys 0.000s
I20260811 12:43:08.381960 15473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:08.384204 15445 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:43:08.384531 15445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "09bb6c43084f4392979d785c2b8ae2a6"
format_stamp: "Formatted at 2026-08-11 12:43:08 on dist-test-slave-qg60"
server_key: "e5cac9c8f3647e8b888f663387f85c50"
server_key_iv: "d315f86387a9d1fec1ba70f3e8a284b2"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:08.384972 15445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:08.422152 15445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:08.428143 15445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:08.428573 15445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:08.430124 15445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:08.432072 15445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:08.432227 15445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:43:08.432392 15445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:08.432487 15445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:08.471995 15445 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:45193
I20260811 12:43:08.472071 15604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:45193 every 8 connection(s)
I20260811 12:43:08.473738 15445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:43:08.481097 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 15445
I20260811 12:43:08.481289 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:43:08.481894 745 external_mini_cluster.cc:1428] Setting key cfe0e3e2d94e54a1a2a54c19add2767a
Aug 11 12:43:08 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:08.512403 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:08.478318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:48769 (local address 127.0.186.126:44193)
0811 12:43:08.485302 (+ 6984us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:08.485309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:08.489726 (+ 4417us) server_negotiation.cc:407] Connection header received
0811 12:43:08.489808 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:08.489817 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:08.489933 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:08.490048 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:08.492555 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:08.494010 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:08.496899 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:08.497664 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:08.497794 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:08.503344 (+ 5550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:08.503355 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:08.503360 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:08.503422 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:08.507604 (+ 4182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:08.508871 (+ 1267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:08.508881 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:08.508908 (+ 27us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:08.509114 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:08.509753 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:08.509761 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:08.509767 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:08.510194 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:08.510352 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:08.511544 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0811 12:43:08.511881 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6832,"thread_start_us":6712,"threads_started":1}
I20260811 12:43:08.516086 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:08.477667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:44193 (local address 127.0.186.66:48769)
0811 12:43:08.486376 (+ 8709us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:08.486444 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:08.489275 (+ 2831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:08.490566 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:08.490581 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:08.491332 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:08.492280 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:08.492313 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:08.494281 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:08.494289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:08.496603 (+ 2314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:08.496626 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:08.498219 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:08.498229 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:08.498599 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:08.499564 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:08.499603 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:08.502997 (+ 3394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:08.507873 (+ 4876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:08.507885 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:08.507909 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:08.508642 (+ 733us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:08.509291 (+ 649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:08.509298 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:08.509304 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:08.509612 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:08.510458 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:08.510470 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:08.511041 (+ 571us) client_negotiation.cc:769] Sending connection context
0811 12:43:08.513018 (+ 1977us) client_negotiation.cc:240] Negotiation successful
0811 12:43:08.513764 (+ 746us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7961,"thread_start_us":7671,"threads_started":1}
I20260811 12:43:08.518296 15605 heartbeater.cc:347] Connected to a master server at 127.0.186.126:44193
I20260811 12:43:08.518646 15605 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:08.519573 15605 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:08.521642 15193 ts_manager.cc:194] Registered new tserver with Master: 09bb6c43084f4392979d785c2b8ae2a6 (127.0.186.66:45193)
I20260811 12:43:08.524693 15193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:48769
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
I20260811 12:43:08.552104 15439 heartbeater.cc:503] Master 127.0.186.126:44193 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:43:08.573392 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:44193
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:09.012758 15611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:09.013170 15611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:09.013379 15611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:09.022290 15611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:09.022472 15611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:09.022687 15611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:43:09.034641 15611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.0.186.84:48399/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:09.036245 15611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:09.037696 15611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:09.053366 15617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:09.053314 15620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:09.053481 15618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:09.054864 15611 server_base.cc:1034] running on GCE node
I20260811 12:43:09.055627 15611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:09.056711 15611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:09.058043 15611 hybrid_clock.cc:648] HybridClock initialized: now 1786452189057914 us; error 92 us; skew 500 ppm
I20260811 12:43:09.058467 15611 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:09 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:09.062139 15611 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:43:09.063862 15611 webserver.cc:460] Webserver started at http://127.0.186.67:42785/ using document root <none> and password file <none>
I20260811 12:43:09.064576 15611 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:09.064911 15611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:09.065272 15611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 12:43:09 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:09.084425 15611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "613a02b748df40d192b45e4695bf7b43"
format_stamp: "Formatted at 2026-08-11 12:43:09 on dist-test-slave-qg60"
server_key: "a0421bfbf341b8eb219aa38b052f3726"
server_key_iv: "e015fdb2715cfda18115c05d37de1210"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:09.085529 15611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "613a02b748df40d192b45e4695bf7b43"
format_stamp: "Formatted at 2026-08-11 12:43:09 on dist-test-slave-qg60"
server_key: "a0421bfbf341b8eb219aa38b052f3726"
server_key_iv: "e015fdb2715cfda18115c05d37de1210"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:09.092636 15611 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260811 12:43:09.111532 15630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:09.113381 15611 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 12:43:09.113631 15611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "613a02b748df40d192b45e4695bf7b43"
format_stamp: "Formatted at 2026-08-11 12:43:09 on dist-test-slave-qg60"
server_key: "a0421bfbf341b8eb219aa38b052f3726"
server_key_iv: "e015fdb2715cfda18115c05d37de1210"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:09.113912 15611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:09.151684 15611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:09.156545 15611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:09.156985 15611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:09.158488 15611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:09.160374 15611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:09.160523 15611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:09.160899 15611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:09.161013 15611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 12:43:09.217033 15611 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:45269
I20260811 12:43:09.217082 15762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:45269 every 8 connection(s)
I20260811 12:43:09.218559 15611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:43:09.222656 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 15611
I20260811 12:43:09.222918 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:43:09.223687 745 external_mini_cluster.cc:1428] Setting key 8a6831d1d96b92c10bb089a12f051d0c
Aug 11 12:43:09 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:09.244371 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:09.222349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:37437 (local address 127.0.186.126:44193)
0811 12:43:09.223460 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:09.223467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:09.224715 (+ 1248us) server_negotiation.cc:407] Connection header received
0811 12:43:09.227134 (+ 2419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:09.227139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:09.227263 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:09.227386 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:09.229132 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.229963 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.231662 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.232221 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.232379 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:09.236626 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:09.236632 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:09.236635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:09.236670 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:09.240573 (+ 3903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.241516 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.241521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.241524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.241813 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.242461 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.242465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.242468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.242788 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:09.243036 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:09.243747 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 12:43:09.244064 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":893,"thread_start_us":711,"threads_started":1}
I20260811 12:43:09.245537 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:09.223351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:44193 (local address 127.0.186.67:37437)
0811 12:43:09.224537 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:09.224590 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:09.226846 (+ 2256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:09.227635 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:09.227644 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:09.228192 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:09.228941 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:09.228969 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.230168 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.230172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:09.231510 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:09.231523 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.232615 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.232630 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:09.233109 (+ 479us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:09.233889 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:09.233917 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:09.236369 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:09.240775 (+ 4406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:09.240794 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:09.240808 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:09.241347 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:09.242007 (+ 660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:09.242011 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:09.242015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:09.242315 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:09.242915 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:09.242922 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:09.243321 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 12:43:09.243607 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 12:43:09.244041 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"thread_start_us":535,"threads_started":1}
I20260811 12:43:09.247539 15763 heartbeater.cc:347] Connected to a master server at 127.0.186.126:44193
I20260811 12:43:09.247931 15763 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:09.249029 15763 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:09.250779 15193 ts_manager.cc:194] Registered new tserver with Master: 613a02b748df40d192b45e4695bf7b43 (127.0.186.67:45269)
I20260811 12:43:09.252159 15193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:37437
I20260811 12:43:09.253865 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:43:09.255748 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 15288
Aug 11 12:43:09 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:43:09.277312 15770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:09.256984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46060 (local address 127.0.186.65:43609)
0811 12:43:09.257853 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:09.257859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:09.257886 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:43:09.257955 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:09.257961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:09.258161 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:09.258296 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:09.260327 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.261544 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.263382 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.264117 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.264221 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:09.269143 (+ 4922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:09.269158 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:09.269175 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:09.269218 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:09.273642 (+ 4424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.274715 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.274723 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.274725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.274906 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.275486 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.275490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.275493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.275894 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:09.276278 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:09.276428 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 12:43:09.276678 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":477,"threads_started":1}
I20260811 12:43:09.278761 15434 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:09.368049 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 15288
I20260811 12:43:09.391122 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 15445
Aug 11 12:43:09 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:43:09.409426 15772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:09.392148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.0.186.66:45193)
0811 12:43:09.392709 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:09.392716 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:09.392802 (+ 86us) server_negotiation.cc:407] Connection header received
0811 12:43:09.392867 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:09.392879 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:09.393188 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:09.393325 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:09.394697 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.395808 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.397382 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.397964 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.398110 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:09.402931 (+ 4821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:09.402945 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:09.402960 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:09.403001 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:09.406250 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.407046 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.407055 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.407057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.407207 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.407570 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.407573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.407576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.407968 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:09.408214 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:09.408602 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 12:43:09.409098 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":293,"threads_started":1}
I20260811 12:43:09.410815 15600 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:09.497749 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 15445
I20260811 12:43:09.525807 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 15611
Aug 11 12:43:09 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:43:09.544209 15775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:09.526889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36796 (local address 127.0.186.67:45269)
0811 12:43:09.527625 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:09.527632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:09.527665 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:43:09.527728 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:09.527735 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:09.527952 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:09.528102 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:09.529528 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.530607 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.532164 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:09.532983 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:09.533109 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:09.537976 (+ 4867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:09.537991 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:09.538008 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:09.538055 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:09.541195 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.542034 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.542042 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.542044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.542185 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:09.542569 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:09.542573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:09.542575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:09.542978 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:09.543284 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:09.543520 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 12:43:09.543746 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":301,"threads_started":1}
I20260811 12:43:09.545615 15757 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:09.634275 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 15611
I20260811 12:43:09.656131 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 15152
I20260811 12:43:09.657768 15227 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:09.770265 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 15152
I20260811 12:43:09.804111 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:44193
--webserver_interface=127.0.186.126
--webserver_port=33345
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:44193
--ranger_config_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:10.174000 15780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:10.174306 15780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:10.174466 15780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:10.182003 15780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:10.182119 15780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:10.182211 15780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:10.182324 15780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:10.182400 15780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:10.193117 15780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:44193
--ranger_config_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:44193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=33345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:10.194609 15780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:10.196173 15780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:10.209478 15785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:10.209442 15789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:10.209519 15786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:10.210296 15780 server_base.cc:1034] running on GCE node
I20260811 12:43:10.211170 15780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:10.212710 15780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:10.214063 15780 hybrid_clock.cc:648] HybridClock initialized: now 1786452190214017 us; error 39 us; skew 500 ppm
I20260811 12:43:10.214656 15780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:10 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452190, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:10.218271 15780 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:10.219997 15780 webserver.cc:460] Webserver started at http://127.0.186.126:33345/ using document root <none> and password file <none>
I20260811 12:43:10.220778 15780 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:10.220948 15780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 12:43:10 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452190, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:10.318881 15780 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 12:43:10.322763 15799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:10.324437 15780 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:43:10.324625 15780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "4466f05a910b46d28ce523f90e90bddd"
format_stamp: "Formatted at 2026-08-11 12:43:05 on dist-test-slave-qg60"
server_key: "a905c7f46cb81abd7a51ca1d2c1f5136"
server_key_iv: "d9e070d360b1022255f505e868cdd06a"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:10.325742 15780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:10.359771 15780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:10.364193 15780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:10.364483 15780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:10.385671 15780 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:44193
I20260811 12:43:10.385692 15859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:44193 every 8 connection(s)
I20260811 12:43:10.387283 15780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:10.390827 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 15780
I20260811 12:43:10.392233 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:43609
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:44193
--webserver_port=43991
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:10.397950 15860 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:43:10.404366 15860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Bootstrap starting.
I20260811 12:43:10.426904 15860 log.cc:824] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:10.437812 15860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:43:10.438499 15860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Bootstrap complete.
I20260811 12:43:10.449383 15860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:10.450498 15860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466f05a910b46d28ce523f90e90bddd, State: Initialized, Role: FOLLOWER
I20260811 12:43:10.451254 15860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:10.451548 15860 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:10.451712 15860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:10.451934 15860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 1 FOLLOWER]: Advancing to term 2
I20260811 12:43:10.456679 15860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:10.457383 15860 leader_election.cc:302] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4466f05a910b46d28ce523f90e90bddd; no voters:
I20260811 12:43:10.458164 15860 leader_election.cc:288] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 12:43:10.458473 15866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 2 FOLLOWER]: Leader election won for term 2
I20260811 12:43:10.459630 15866 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [term 2 LEADER]: Becoming Leader. State: Replica: 4466f05a910b46d28ce523f90e90bddd, State: Running, Role: LEADER
I20260811 12:43:10.460417 15866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } }
I20260811 12:43:10.460943 15860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:10.463300 15868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4466f05a910b46d28ce523f90e90bddd. Latest consensus state: current_term: 2 leader_uuid: "4466f05a910b46d28ce523f90e90bddd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } } }
I20260811 12:43:10.463739 15868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:10.464315 15867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4466f05a910b46d28ce523f90e90bddd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4466f05a910b46d28ce523f90e90bddd" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 44193 } } }
I20260811 12:43:10.464615 15867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:10.466598 15872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:10.474797 15872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:10.477239 15872 catalog_manager.cc:1259] Loaded cluster ID: ee8a6854accd4f6f8446b6d1bd291b64
I20260811 12:43:10.477524 15872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:10.483975 15872 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:10.486481 15872 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Loaded TSK: 0
I20260811 12:43:10.488906 15872 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:43:10.494227 15860 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 12:43:10.880347 15862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:10.880827 15862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:10.880995 15862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:10.893224 15862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:10.893386 15862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:10.893643 15862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:43:10.910401 15862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:43609
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=43991
--tserver_master_addrs=127.0.186.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:10.912539 15862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:10.914485 15862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:10.971752 15906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:10.971851 15908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:10.972608 15902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:10.974434 15862 server_base.cc:1034] running on GCE node
I20260811 12:43:10.975378 15862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:10.989159 15862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:10.993141 15862 hybrid_clock.cc:648] HybridClock initialized: now 1786452190993008 us; error 106 us; skew 500 ppm
I20260811 12:43:10.993733 15862 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:10 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452190, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:10.998807 15862 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:43:11.021381 15862 webserver.cc:460] Webserver started at http://127.0.186.65:43991/ using document root <none> and password file <none>
I20260811 12:43:11.022555 15862 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:11.022848 15862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 12:43:11 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452190, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:11.065856 15862 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.000s sys 0.004s
I20260811 12:43:11.079752 15918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:11.082175 15862 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.008s sys 0.004s
I20260811 12:43:11.082465 15862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "c43e0fd3d20c40099da0d9272f04b908"
format_stamp: "Formatted at 2026-08-11 12:43:07 on dist-test-slave-qg60"
server_key: "b0730f73ab2a26ac22af8f75fa053f0e"
server_key_iv: "42d1fb719ae74c4d509e5494202a6f58"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:11.084077 15862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:11.123216 15862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:11.128755 15862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:11.129266 15862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:11.130693 15862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:11.132702 15862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:11.132879 15862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 12:43:11.133009 15862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:11.133088 15862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:11.201071 15862 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:43609
I20260811 12:43:11.201113 16054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:43609 every 8 connection(s)
I20260811 12:43:11.202819 15862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:43:11.204689 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 15862
I20260811 12:43:11.205627 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:45193
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:44193
--webserver_port=32873
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:43:11 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452190, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:11.269490 16058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:11.207355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:41333 (local address 127.0.186.126:44193)
0811 12:43:11.222549 (+ 15194us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:11.222589 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:11.224795 (+ 2206us) server_negotiation.cc:407] Connection header received
0811 12:43:11.240013 (+ 15218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:11.240042 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:11.240679 (+ 637us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:11.241190 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:11.246388 (+ 5198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.248430 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.251098 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.252287 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.252493 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:11.257820 (+ 5327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:11.257833 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:11.257855 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:11.257920 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:11.262469 (+ 4549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:11.263620 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:11.263632 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:11.263640 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:11.263875 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:11.264794 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:11.264800 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:11.264803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:11.265685 (+ 882us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:11.265916 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:11.267238 (+ 1322us) server_negotiation.cc:299] Negotiation successful
0811 12:43:11.267851 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14443,"thread_start_us":14198,"threads_started":1}
I20260811 12:43:11.269587 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:11.207421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:44193 (local address 127.0.186.65:41333)
0811 12:43:11.223912 (+ 16491us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:11.223985 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:11.239007 (+ 15022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:11.242165 (+ 3158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:11.242177 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:11.242854 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:11.246092 (+ 3238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:11.246125 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.248693 (+ 2568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.248703 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:11.250868 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:11.250902 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.253073 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.253082 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:11.253373 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:11.254336 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:11.254372 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:11.257418 (+ 3046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:11.262720 (+ 5302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:11.262729 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:11.262747 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:11.263409 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:11.264206 (+ 797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:11.264212 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:11.264216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:11.264577 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:11.266066 (+ 1489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:11.266075 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:11.266560 (+ 485us) client_negotiation.cc:769] Sending connection context
0811 12:43:11.267640 (+ 1080us) client_negotiation.cc:240] Negotiation successful
0811 12:43:11.268212 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16124,"thread_start_us":15908,"threads_started":1}
I20260811 12:43:11.273811 16055 heartbeater.cc:347] Connected to a master server at 127.0.186.126:44193
I20260811 12:43:11.274204 16055 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:11.275218 16055 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
W20260811 12:43:11.279019 16055 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:44193 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 12:43:11.279304 16055 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:11.279650 16055 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:11.281246 16055 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:11.281663 16055 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
W20260811 12:43:11.283058 16055 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 12:43:11.728822 16059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:11.729418 16059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:11.729673 16059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:11.739969 16059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:11.740142 16059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:11.740407 16059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:43:11.752310 16059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:45193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=32873
--tserver_master_addrs=127.0.186.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:11.754107 16059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:11.755645 16059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:11.775004 16081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:11.782352 16082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:11.783350 16084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:11.783450 16059 server_base.cc:1034] running on GCE node
I20260811 12:43:11.784479 16059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:11.785894 16059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:11.787218 16059 hybrid_clock.cc:648] HybridClock initialized: now 1786452191787145 us; error 64 us; skew 500 ppm
I20260811 12:43:11.787597 16059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:11 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:11.791632 16059 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:43:11.797016 16059 webserver.cc:460] Webserver started at http://127.0.186.66:32873/ using document root <none> and password file <none>
I20260811 12:43:11.797827 16059 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:11.798012 16059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 12:43:11 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
Aug 11 12:43:11 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786452191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:11.822350 16059 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 12:43:11.828976 16092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:11.831073 16059 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.005s sys 0.000s
I20260811 12:43:11.831317 16059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "09bb6c43084f4392979d785c2b8ae2a6"
format_stamp: "Formatted at 2026-08-11 12:43:08 on dist-test-slave-qg60"
server_key: "e5cac9c8f3647e8b888f663387f85c50"
server_key_iv: "d315f86387a9d1fec1ba70f3e8a284b2"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:11.832965 16059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:11.881958 16059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:11.887526 16059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:11.887871 16059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:11.889350 16059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:11.891469 16059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:11.891592 16059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:11.891758 16059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:11.891877 16059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:11.936507 16059 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:45193
I20260811 12:43:11.936558 16222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:45193 every 8 connection(s)
I20260811 12:43:11.938607 16059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:43:11.940953 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16059
I20260811 12:43:11.941840 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.186.84:48399/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:45269
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:44193
--webserver_port=42785
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:43:11 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:11.990579 16231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:11.943538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:33737 (local address 127.0.186.126:44193)
0811 12:43:11.967047 (+ 23509us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:11.967057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:11.969568 (+ 2511us) server_negotiation.cc:407] Connection header received
0811 12:43:11.973237 (+ 3669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:11.973245 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:11.973351 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:11.973494 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:11.975737 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.976957 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.978835 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.979285 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.979434 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:11.983592 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:11.983599 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:11.983604 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:11.983648 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:11.986937 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:11.987696 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:11.987702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:11.987705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:11.987838 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:11.988305 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:11.988311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:11.988314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:11.988601 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:11.988798 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:11.989675 (+ 877us) server_negotiation.cc:299] Negotiation successful
0811 12:43:11.989903 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23309,"thread_start_us":23528,"threads_started":1}
I20260811 12:43:11.991540 16229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:11.942790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:44193 (local address 127.0.186.66:33737)
0811 12:43:11.967856 (+ 25066us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:11.967929 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:11.971213 (+ 3284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:11.973797 (+ 2584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:11.973812 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:11.974583 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:11.975491 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:11.975539 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.977169 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.977175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:11.978634 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:11.978671 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:11.979559 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:11.979568 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:11.979827 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:11.980580 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:11.980605 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:11.983301 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:11.987090 (+ 3789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:11.987100 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:11.987124 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:11.987559 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:11.987956 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:11.987962 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:11.987966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:11.988182 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:11.988784 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:11.988792 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:11.989249 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 12:43:11.989562 (+ 313us) client_negotiation.cc:240] Negotiation successful
0811 12:43:11.990139 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24649,"thread_start_us":28665,"threads_started":1}
I20260811 12:43:11.993172 16224 heartbeater.cc:347] Connected to a master server at 127.0.186.126:44193
I20260811 12:43:11.993517 16224 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:11.994390 16224 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:11.996519 15819 ts_manager.cc:194] Registered new tserver with Master: 09bb6c43084f4392979d785c2b8ae2a6 (127.0.186.66:45193)
I20260811 12:43:11.998548 15819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:33737
I20260811 12:43:12.283245 16055 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:12.283761 16055 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:12.285355 15819 ts_manager.cc:194] Registered new tserver with Master: c43e0fd3d20c40099da0d9272f04b908 (127.0.186.65:43609)
I20260811 12:43:12.286629 15819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:41333
Aug 11 12:43:12 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
W20260811 12:43:12.440336 16232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:12.440872 16232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:12.441077 16232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:12.452639 16232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:12.452895 16232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:12.453120 16232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:43:12.469413 16232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.186.84:48399/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:45269
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=42785
--tserver_master_addrs=127.0.186.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:12.471340 16232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:12.473225 16232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:12.517426 16238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:12.521351 16232 server_base.cc:1034] running on GCE node
W20260811 12:43:12.524997 16239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:12.524963 16243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:12.526163 16232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:12.536430 16232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:12.537963 16232 hybrid_clock.cc:648] HybridClock initialized: now 1786452192537855 us; error 113 us; skew 500 ppm
I20260811 12:43:12.538446 16232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:12 dist-test-slave-qg60 krb5kdc[14631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452192, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:12.543205 16232 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:43:12.546312 16232 webserver.cc:460] Webserver started at http://127.0.186.67:42785/ using document root <none> and password file <none>
I20260811 12:43:12.547380 16232 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:12.547578 16232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 12:43:12 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452192, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:12.587572 16232 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.011s sys 0.008s
I20260811 12:43:12.592482 16250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:12.596213 16232 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260811 12:43:12.596403 16232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "613a02b748df40d192b45e4695bf7b43"
format_stamp: "Formatted at 2026-08-11 12:43:09 on dist-test-slave-qg60"
server_key: "a0421bfbf341b8eb219aa38b052f3726"
server_key_iv: "e015fdb2715cfda18115c05d37de1210"
server_key_version: "kuduclusterkey@0"
I20260811 12:43:12.597935 16232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:12.667810 16232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:12.682919 16232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:12.683269 16232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:12.690299 16232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:12.697485 16232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:12.697623 16232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:12.697739 16232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:12.697801 16232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 12:43:12 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for HTTP/127.0.186.84@KRBTEST.COM
I20260811 12:43:12.907977 16232 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:45269
I20260811 12:43:12.910092 16232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:43:12.908277 16393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:45269 every 8 connection(s)
I20260811 12:43:12.914706 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16232
Aug 11 12:43:12 dist-test-slave-qg60 krb5kdc[14631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452192, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:12.977051 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:12.917226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33194 (local address 127.0.186.126:44193)
0811 12:43:12.946149 (+ 28923us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:12.946157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:12.952305 (+ 6148us) server_negotiation.cc:407] Connection header received
0811 12:43:12.952392 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:12.952398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:12.952562 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:12.952691 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:12.955700 (+ 3009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:12.957256 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:12.960105 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:12.961082 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:12.961198 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:12.966702 (+ 5504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:12.966711 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:12.966716 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:12.966802 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:12.971783 (+ 4981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:12.973426 (+ 1643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:12.973433 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:12.973438 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:12.973868 (+ 430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:12.974725 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:12.974732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:12.974735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:12.975201 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:12.975519 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:12.976246 (+ 727us) server_negotiation.cc:299] Negotiation successful
0811 12:43:12.976528 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":28747,"thread_start_us":28913,"threads_started":1}
I20260811 12:43:12.983394 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:12.946350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:33241 (local address 127.0.186.126:44193)
0811 12:43:12.951046 (+ 4696us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:12.951053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:12.951098 (+ 45us) server_negotiation.cc:407] Connection header received
0811 12:43:12.955591 (+ 4493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:12.955597 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:12.955766 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:12.956309 (+ 543us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:12.959607 (+ 3298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:12.961757 (+ 2150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:12.965579 (+ 3822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:12.966329 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:12.966443 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:12.972072 (+ 5629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:12.972080 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:12.972085 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:12.972135 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:12.975890 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:12.980086 (+ 4196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:12.980093 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:12.980097 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:12.980265 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:12.980990 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:12.980995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:12.980998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:12.981405 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:12.981567 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:12.982675 (+ 1108us) server_negotiation.cc:299] Negotiation successful
0811 12:43:12.982916 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":407,"server-negotiator.queue_time_us":4511,"thread_start_us":4771,"threads_started":1}
I20260811 12:43:12.985796 16398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:12.918071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:44193 (local address 127.0.186.67:33241)
0811 12:43:12.943131 (+ 25060us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:12.943223 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:12.955058 (+ 11835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:12.957293 (+ 2235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:12.957309 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:12.958093 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:12.959282 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:12.959314 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:12.962592 (+ 3278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:12.962598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:12.965339 (+ 2741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:12.965364 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:12.967167 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:12.967177 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:12.967505 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:12.968615 (+ 1110us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:12.968648 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:12.971703 (+ 3055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:12.976075 (+ 4372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:12.976087 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:12.976106 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:12.976789 (+ 683us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:12.980440 (+ 3651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:12.980446 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:12.980450 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:12.980839 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:12.981694 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:12.981705 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:12.982183 (+ 478us) client_negotiation.cc:769] Sending connection context
0811 12:43:12.983685 (+ 1502us) client_negotiation.cc:240] Negotiation successful
0811 12:43:12.984316 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24412,"thread_start_us":26493,"threads_started":1}
I20260811 12:43:12.987457 16394 heartbeater.cc:347] Connected to a master server at 127.0.186.126:44193
I20260811 12:43:12.987808 16394 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:12.988776 16394 heartbeater.cc:511] Master 127.0.186.126:44193 requested a full tablet report, sending...
I20260811 12:43:12.990753 15819 ts_manager.cc:194] Registered new tserver with Master: 613a02b748df40d192b45e4695bf7b43 (127.0.186.67:45269)
I20260811 12:43:12.991950 15819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:33241
I20260811 12:43:12.994614 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:43:13.003638 16224 heartbeater.cc:503] Master 127.0.186.126:44193 was elected leader, sending a full tablet report...
I20260811 12:43:13.023813 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:12.999951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33210 (local address 127.0.186.126:44193)
0811 12:43:13.000159 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.000166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.000991 (+ 825us) server_negotiation.cc:407] Connection header received
0811 12:43:13.001320 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.001327 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.001431 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.001530 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:13.005373 (+ 3843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.006806 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.009235 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.010092 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.010236 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.014589 (+ 4353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:13.014597 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:13.014603 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:13.014656 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:13.019803 (+ 5147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.020895 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.020907 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.020910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.021168 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.021911 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.021917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.021921 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.022272 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:13.022588 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.023115 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.023439 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 12:43:13.031065 15819 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:43:13.045957 15819 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:43:13.101886 16424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.073759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36806 (local address 127.0.186.67:45269)
0811 12:43:13.081630 (+ 7871us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.081645 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.081732 (+ 87us) server_negotiation.cc:407] Connection header received
0811 12:43:13.083799 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.083814 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.084264 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.084490 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:13.087495 (+ 3005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.091246 (+ 3751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.096395 (+ 5149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.098349 (+ 1954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.098473 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.100119 (+ 1646us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.101084 (+ 965us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.101327 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7585,"thread_start_us":7997,"threads_started":1}
I20260811 12:43:13.102957 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.073263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:45269 (local address 127.0.0.1:36806)
0811 12:43:13.074443 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:13.074488 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:13.083444 (+ 8956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:13.085277 (+ 1833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:13.085290 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:13.085354 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:13.086214 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.086235 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.091553 (+ 5318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.091562 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.096191 (+ 4629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.096208 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.100373 (+ 4165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.100380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.100649 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.100707 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 12:43:13.102271 (+ 1564us) client_negotiation.cc:240] Negotiation successful
0811 12:43:13.102537 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"thread_start_us":665,"threads_started":1}
I20260811 12:43:13.105466 16425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.081002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:45193 (local address 127.0.0.1:50320)
0811 12:43:13.089474 (+ 8472us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:13.089502 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:13.089660 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:13.090748 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:13.090751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:13.090774 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:13.091535 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.091556 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.094000 (+ 2444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.094006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.101757 (+ 7751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.101779 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.104252 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.104260 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.104481 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.104521 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 12:43:13.104624 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 12:43:13.104839 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8318,"mutex_wait_us":4,"thread_start_us":8077,"threads_started":1}
I20260811 12:43:13.107667 16314 tablet_service.cc:1467] Processing CreateTablet for tablet 6738521e8f6742dcbaf91a4f3f4de395 (DEFAULT_TABLE table=test-table [id=0227dd24a6fc4298bf3d222b4ec43b8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:13.109277 16314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6738521e8f6742dcbaf91a4f3f4de395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:13.110865 16426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.081375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.0.186.66:45193)
0811 12:43:13.082561 (+ 1186us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.082568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.089819 (+ 7251us) server_negotiation.cc:407] Connection header received
0811 12:43:13.089937 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.089946 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.090245 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.090481 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:13.091870 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.093802 (+ 1932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.101976 (+ 8174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.103896 (+ 1920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.104090 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.109959 (+ 5869us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.110056 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.110356 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1021,"thread_start_us":824,"threads_started":1}
I20260811 12:43:13.115824 16151 tablet_service.cc:1467] Processing CreateTablet for tablet 6738521e8f6742dcbaf91a4f3f4de395 (DEFAULT_TABLE table=test-table [id=0227dd24a6fc4298bf3d222b4ec43b8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:13.117939 16151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6738521e8f6742dcbaf91a4f3f4de395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:13.119387 16427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.083047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43609 (local address 127.0.0.1:46066)
0811 12:43:13.101454 (+ 18407us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:13.101481 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:13.101626 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:13.108866 (+ 7240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:13.108871 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:13.108918 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:13.109639 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.109659 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.112114 (+ 2455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.112120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.116356 (+ 4236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.116373 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.118260 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.118271 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.118501 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.118530 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 12:43:13.118645 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 12:43:13.118806 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18230,"thread_start_us":17985,"threads_started":1}
I20260811 12:43:13.119365 16428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.083470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46066 (local address 127.0.186.65:43609)
0811 12:43:13.103813 (+ 20343us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.103822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.103854 (+ 32us) server_negotiation.cc:407] Connection header received
0811 12:43:13.103975 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.103984 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.104317 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.104540 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:13.110034 (+ 5494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.111860 (+ 1826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.116558 (+ 4698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.117795 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.117992 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.118376 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.118720 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.118909 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20130,"thread_start_us":18845,"threads_started":1}
I20260811 12:43:13.123940 15974 tablet_service.cc:1467] Processing CreateTablet for tablet 6738521e8f6742dcbaf91a4f3f4de395 (DEFAULT_TABLE table=test-table [id=0227dd24a6fc4298bf3d222b4ec43b8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:13.125360 15974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6738521e8f6742dcbaf91a4f3f4de395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:13.130980 16429 tablet_bootstrap.cc:492] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Bootstrap starting.
I20260811 12:43:13.136301 16429 tablet_bootstrap.cc:654] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:13.137784 16430 tablet_bootstrap.cc:492] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Bootstrap starting.
I20260811 12:43:13.138196 16429 log.cc:824] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:13.142445 16430 tablet_bootstrap.cc:654] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:13.142583 16429 tablet_bootstrap.cc:492] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: No bootstrap required, opened a new log
I20260811 12:43:13.142899 16429 ts_tablet_manager.cc:1397] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260811 12:43:13.143966 16432 tablet_bootstrap.cc:492] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Bootstrap starting.
I20260811 12:43:13.144273 16430 log.cc:824] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:13.148516 16432 tablet_bootstrap.cc:654] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:13.148530 16430 tablet_bootstrap.cc:492] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: No bootstrap required, opened a new log
I20260811 12:43:13.148931 16430 ts_tablet_manager.cc:1397] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260811 12:43:13.149891 16432 log.cc:824] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:13.153124 16432 tablet_bootstrap.cc:492] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: No bootstrap required, opened a new log
I20260811 12:43:13.153524 16432 ts_tablet_manager.cc:1397] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260811 12:43:13.157586 16429 raft_consensus.cc:348] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.158334 16429 raft_consensus.cc:374] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:13.158464 16429 raft_consensus.cc:729] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 613a02b748df40d192b45e4695bf7b43, State: Initialized, Role: FOLLOWER
I20260811 12:43:13.159297 16429 consensus_queue.cc:260] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.161068 16394 heartbeater.cc:503] Master 127.0.186.126:44193 was elected leader, sending a full tablet report...
I20260811 12:43:13.162317 16429 ts_tablet_manager.cc:1428] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Time spent starting tablet: real 0.019s user 0.017s sys 0.003s
I20260811 12:43:13.163125 16430 raft_consensus.cc:348] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.164397 16430 raft_consensus.cc:374] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:13.164642 16430 raft_consensus.cc:729] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bb6c43084f4392979d785c2b8ae2a6, State: Initialized, Role: FOLLOWER
I20260811 12:43:13.165702 16430 consensus_queue.cc:260] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.165757 16432 raft_consensus.cc:348] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.166328 16432 raft_consensus.cc:374] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:13.166486 16432 raft_consensus.cc:729] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43e0fd3d20c40099da0d9272f04b908, State: Initialized, Role: FOLLOWER
I20260811 12:43:13.167207 16432 consensus_queue.cc:260] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.170838 16430 ts_tablet_manager.cc:1428] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Time spent starting tablet: real 0.022s user 0.013s sys 0.007s
I20260811 12:43:13.171813 16055 heartbeater.cc:503] Master 127.0.186.126:44193 was elected leader, sending a full tablet report...
I20260811 12:43:13.172432 16432 ts_tablet_manager.cc:1428] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Time spent starting tablet: real 0.019s user 0.007s sys 0.012s
W20260811 12:43:13.175818 16395 tablet.cc:2369] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:43:13.224301 16228 tablet.cc:2369] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:13.225219 16435 raft_consensus.cc:482] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:13.225739 16435 raft_consensus.cc:504] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.227773 16435 leader_election.cc:288] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c43e0fd3d20c40099da0d9272f04b908 (127.0.186.65:43609), 09bb6c43084f4392979d785c2b8ae2a6 (127.0.186.66:45193)
W20260811 12:43:13.228003 16056 tablet.cc:2369] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:13.237774 16428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.228548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:38487 (local address 127.0.186.65:43609)
0811 12:43:13.228900 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.228909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.228935 (+ 26us) server_negotiation.cc:407] Connection header received
0811 12:43:13.229020 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.229027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.229138 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.229260 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:13.230135 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.231485 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.234650 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.236375 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.236608 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.236707 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.237266 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.237384 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 12:43:13.238126 16398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.228075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:43609 (local address 127.0.186.67:38487)
0811 12:43:13.228554 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:13.228579 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:13.228772 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:13.229508 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:13.229516 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:13.229548 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:13.229949 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.229960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.231674 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.231678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.234371 (+ 2693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.234388 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.236578 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.236583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.236975 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.237028 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 12:43:13.237225 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 12:43:13.237389 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":27}
I20260811 12:43:13.238526 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.228290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:45193 (local address 127.0.186.67:40345)
0811 12:43:13.229590 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:13.229643 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:13.229799 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:13.230192 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:13.230198 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:13.230227 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:13.230983 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.230998 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.232071 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.232077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.234832 (+ 2755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:13.234844 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.237129 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.237137 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:13.237359 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.237392 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 12:43:13.237505 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 12:43:13.237658 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1199,"mutex_wait_us":54,"thread_start_us":914,"threads_started":1}
I20260811 12:43:13.238528 16426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.229316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:40345 (local address 127.0.186.66:45193)
0811 12:43:13.229573 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.229579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.229738 (+ 159us) server_negotiation.cc:407] Connection header received
0811 12:43:13.229967 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.229971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.230055 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.230164 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:13.231213 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.231911 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.235003 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.236840 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.236985 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.237057 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.237569 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.237751 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 12:43:13.240013 15996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6738521e8f6742dcbaf91a4f3f4de395" candidate_uuid: "613a02b748df40d192b45e4695bf7b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43e0fd3d20c40099da0d9272f04b908" is_pre_election: true
I20260811 12:43:13.240281 16173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6738521e8f6742dcbaf91a4f3f4de395" candidate_uuid: "613a02b748df40d192b45e4695bf7b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09bb6c43084f4392979d785c2b8ae2a6" is_pre_election: true
I20260811 12:43:13.240990 16173 raft_consensus.cc:2454] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 613a02b748df40d192b45e4695bf7b43 in term 0.
I20260811 12:43:13.241035 15996 raft_consensus.cc:2454] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 613a02b748df40d192b45e4695bf7b43 in term 0.
I20260811 12:43:13.241993 16254 leader_election.cc:302] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 09bb6c43084f4392979d785c2b8ae2a6, 613a02b748df40d192b45e4695bf7b43, c43e0fd3d20c40099da0d9272f04b908; no voters:
I20260811 12:43:13.242463 16435 raft_consensus.cc:2781] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:43:13.242661 16435 raft_consensus.cc:482] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:43:13.242849 16435 raft_consensus.cc:3037] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:13.245901 16435 raft_consensus.cc:504] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.246806 16435 leader_election.cc:288] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [CANDIDATE]: Term 1 election: Requested vote from peers c43e0fd3d20c40099da0d9272f04b908 (127.0.186.65:43609), 09bb6c43084f4392979d785c2b8ae2a6 (127.0.186.66:45193)
I20260811 12:43:13.247417 15996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6738521e8f6742dcbaf91a4f3f4de395" candidate_uuid: "613a02b748df40d192b45e4695bf7b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43e0fd3d20c40099da0d9272f04b908"
I20260811 12:43:13.247431 16173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6738521e8f6742dcbaf91a4f3f4de395" candidate_uuid: "613a02b748df40d192b45e4695bf7b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09bb6c43084f4392979d785c2b8ae2a6"
I20260811 12:43:13.247701 16173 raft_consensus.cc:3037] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:13.247727 15996 raft_consensus.cc:3037] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:13.250900 15996 raft_consensus.cc:2454] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 613a02b748df40d192b45e4695bf7b43 in term 1.
I20260811 12:43:13.250965 16173 raft_consensus.cc:2454] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 613a02b748df40d192b45e4695bf7b43 in term 1.
I20260811 12:43:13.251469 16254 leader_election.cc:302] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 613a02b748df40d192b45e4695bf7b43, c43e0fd3d20c40099da0d9272f04b908; no voters:
I20260811 12:43:13.251829 16435 raft_consensus.cc:2781] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:13.252615 16435 raft_consensus.cc:686] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 1 LEADER]: Becoming Leader. State: Replica: 613a02b748df40d192b45e4695bf7b43, State: Running, Role: LEADER
I20260811 12:43:13.253475 16435 consensus_queue.cc:237] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } }
I20260811 12:43:13.259546 15819 catalog_manager.cc:5495] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 613a02b748df40d192b45e4695bf7b43 (127.0.186.67). New cstate: current_term: 1 leader_uuid: "613a02b748df40d192b45e4695bf7b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "613a02b748df40d192b45e4695bf7b43" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 45269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 } health_report { overall_health: UNKNOWN } } }
I20260811 12:43:13.293378 16424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.286251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.0.186.67:45269)
0811 12:43:13.286609 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.286615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.286721 (+ 106us) server_negotiation.cc:407] Connection header received
0811 12:43:13.286918 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.286922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.287005 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.287141 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:43:13.287641 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.288555 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.290626 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.291325 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.291450 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.292083 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:43:13.292633 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:43:13.292812 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.292923 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.293002 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205}
I20260811 12:43:13.304920 16173 raft_consensus.cc:1261] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 1 FOLLOWER]: Refusing update from remote peer 613a02b748df40d192b45e4695bf7b43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:13.304956 15996 raft_consensus.cc:1261] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 1 FOLLOWER]: Refusing update from remote peer 613a02b748df40d192b45e4695bf7b43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:13.306169 16440 consensus_queue.cc:1035] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c43e0fd3d20c40099da0d9272f04b908" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 43609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:13.306734 16435 consensus_queue.cc:1035] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09bb6c43084f4392979d785c2b8ae2a6" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:13.321770 16446 mvcc.cc:205] Tried to move back new op lower bound from 7317308183763128320 to 7317308183571144704. Current Snapshot: MvccSnapshot[applied={T|T < 7317308183763128320}]
I20260811 12:43:13.340308 15818 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:13.340798 15818 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:13.345541 15818 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4466f05a910b46d28ce523f90e90bddd: Sending DeleteTablet for 3 replicas of tablet 6738521e8f6742dcbaf91a4f3f4de395
I20260811 12:43:13.347206 16151 tablet_service.cc:1514] Processing DeleteTablet for tablet 6738521e8f6742dcbaf91a4f3f4de395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:13 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:50320
I20260811 12:43:13.347270 15974 tablet_service.cc:1514] Processing DeleteTablet for tablet 6738521e8f6742dcbaf91a4f3f4de395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:13 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:46066
I20260811 12:43:13.348590 16314 tablet_service.cc:1514] Processing DeleteTablet for tablet 6738521e8f6742dcbaf91a4f3f4de395 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:13 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:36806
I20260811 12:43:13.356575 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 15862
I20260811 12:43:13.363857 16461 tablet_replica.cc:330] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: stopping tablet replica
I20260811 12:43:13.364318 16460 tablet_replica.cc:330] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: stopping tablet replica
I20260811 12:43:13.365159 16460 raft_consensus.cc:2229] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:13.365881 16459 tablet_replica.cc:330] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: stopping tablet replica
I20260811 12:43:13.365993 16460 raft_consensus.cc:2258] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:13.366454 16459 raft_consensus.cc:2229] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:13.367331 16461 raft_consensus.cc:2229] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:43:13.368309 16460 ts_tablet_manager.cc:1905] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:13.368643 16461 raft_consensus.cc:2258] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:13.369534 16459 raft_consensus.cc:2258] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:13.371558 16461 ts_tablet_manager.cc:1905] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:13.371850 16459 ts_tablet_manager.cc:1905] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:13.379088 16460 ts_tablet_manager.cc:1918] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:13.379407 16460 log.cc:1196] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/6738521e8f6742dcbaf91a4f3f4de395
I20260811 12:43:13.382416 16459 ts_tablet_manager.cc:1918] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:13.382716 16459 log.cc:1196] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/6738521e8f6742dcbaf91a4f3f4de395
I20260811 12:43:13.383741 16459 ts_tablet_manager.cc:1939] T 6738521e8f6742dcbaf91a4f3f4de395 P 09bb6c43084f4392979d785c2b8ae2a6: Deleting consensus metadata
I20260811 12:43:13.385831 16460 ts_tablet_manager.cc:1939] T 6738521e8f6742dcbaf91a4f3f4de395 P c43e0fd3d20c40099da0d9272f04b908: Deleting consensus metadata
I20260811 12:43:13.389540 16428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.358135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39550 (local address 127.0.186.65:43609)
0811 12:43:13.358345 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.358352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.358500 (+ 148us) server_negotiation.cc:407] Connection header received
0811 12:43:13.358760 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.358766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.358885 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.359029 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:13.361414 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.363196 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.366118 (+ 2922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.366897 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.367040 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.378340 (+ 11300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:13.378358 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:13.378377 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:13.378429 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:13.384961 (+ 6532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.386224 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.386238 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.386241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.386453 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.386933 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.386938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.386941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.387580 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:13.388131 (+ 551us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.388341 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.388696 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:43:13.392982 16461 ts_tablet_manager.cc:1918] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:13.393550 16461 log.cc:1196] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/6738521e8f6742dcbaf91a4f3f4de395
I20260811 12:43:13.394991 16461 ts_tablet_manager.cc:1939] T 6738521e8f6742dcbaf91a4f3f4de395 P 613a02b748df40d192b45e4695bf7b43: Deleting consensus metadata
I20260811 12:43:13.398070 16050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:13.398064 15802 catalog_manager.cc:4841] TS 613a02b748df40d192b45e4695bf7b43 (127.0.186.67:45269): tablet 6738521e8f6742dcbaf91a4f3f4de395 (table test-table [id=0227dd24a6fc4298bf3d222b4ec43b8a]) successfully deleted
I20260811 12:43:13.400065 15804 catalog_manager.cc:4841] TS 09bb6c43084f4392979d785c2b8ae2a6 (127.0.186.66:45193): tablet 6738521e8f6742dcbaf91a4f3f4de395 (table test-table [id=0227dd24a6fc4298bf3d222b4ec43b8a]) successfully deleted
I20260811 12:43:13.511783 15802 catalog_manager.cc:4841] TS c43e0fd3d20c40099da0d9272f04b908 (127.0.186.65:43609): tablet 6738521e8f6742dcbaf91a4f3f4de395 (table test-table [id=0227dd24a6fc4298bf3d222b4ec43b8a]) successfully deleted
I20260811 12:43:13.511961 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 15862
I20260811 12:43:13.542855 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16059
I20260811 12:43:13.561117 16426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.543808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39056 (local address 127.0.186.66:45193)
0811 12:43:13.544024 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.544029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.544122 (+ 93us) server_negotiation.cc:407] Connection header received
0811 12:43:13.544304 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.544308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.544397 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.544501 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:13.546450 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.547237 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.549421 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.549849 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.549961 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.553415 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:13.553432 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:13.553448 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:13.553486 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:13.557164 (+ 3678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.558177 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.558189 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.558193 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.558486 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.558954 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.558958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.558960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.559483 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:13.559790 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.560181 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.560410 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 12:43:13.562090 16218 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:13.676851 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16059
I20260811 12:43:13.699568 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16232
I20260811 12:43:13.715359 16424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:13.700635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44326 (local address 127.0.186.67:45269)
0811 12:43:13.700869 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:13.700877 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:13.700903 (+ 26us) server_negotiation.cc:407] Connection header received
0811 12:43:13.700985 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:13.700989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:13.701067 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:13.701183 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:13.702661 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.703611 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.705388 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:13.705858 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:13.706047 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:13.708718 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:13.708803 (+ 85us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:13.708829 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:13.708875 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:13.712201 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.713081 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.713090 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.713094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.713272 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:13.713696 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:13.713701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:13.713705 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:13.714081 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:13.714454 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:13.714731 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 12:43:13.714968 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:43:13.716233 16388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:13.844336 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16232
I20260811 12:43:13.872215 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 15780
I20260811 12:43:13.873560 15854 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:13.993062 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 15780
I20260811 12:43:14.027737 745 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 12:43:14.374176 745 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 12:43:14.374434 745 mini_ranger.cc:66] Stopping Ranger...
I20260811 12:43:14.722368 745 mini_ranger.cc:68] Stopped Ranger
2026-08-11 12:43:14.722 UTC [14664] LOG: received smart shutdown request
2026-08-11 12:43:14.726 UTC [14664] LOG: background worker "logical replication launcher" (PID 14674) exited with exit code 1
2026-08-11 12:43:14.726 UTC [14668] LOG: shutting down
2026-08-11 12:43:14.902 UTC [14664] LOG: database system is shut down
2026-08-11T12:43:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (58578 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:43:15 dist-test-slave-qg60 krb5kdc[16475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:43:15 dist-test-slave-qg60 krb5kdc[16475](info): set up 2 sockets
Aug 11 12:43:15 dist-test-slave-qg60 krb5kdc[16475](info): commencing operation
krb5kdc: starting...
W20260811 12:43:16.297112 745 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.007s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:43:16 dist-test-slave-qg60 krb5kdc[16475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:43:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:43:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:43:16.636499 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:38719
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:38719,127.0.186.125:40201,127.0.186.124:38179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:17.004568 16490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:17.005013 16490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:17.005184 16490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:17.012866 16490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:17.013041 16490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:17.013155 16490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:17.013269 16490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:17.013362 16490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:17.023795 16490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:38719,127.0.186.125:40201,127.0.186.124:38179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:38719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:17.025343 16490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:17.026767 16490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:17.039678 16498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:17.039595 16496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:17.039692 16495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:17.040694 16490 server_base.cc:1034] running on GCE node
I20260811 12:43:17.041641 16490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:17.043237 16490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:17.044489 16490 hybrid_clock.cc:648] HybridClock initialized: now 1786452197044426 us; error 87 us; skew 500 ppm
I20260811 12:43:17.044957 16490 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:17 dist-test-slave-qg60 krb5kdc[16475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:17.048450 16490 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:17.050258 16490 webserver.cc:460] Webserver started at http://127.0.186.126:44033/ using document root <none> and password file <none>
I20260811 12:43:17.050973 16490 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:17.051091 16490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:17.051365 16490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:17.054607 16490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "e4e1eebcdffc40e2af5698dd80305f1b"
format_stamp: "Formatted at 2026-08-11 12:43:17 on dist-test-slave-qg60"
server_key: "3d76f5da281aafe568df43f8f91ef2d7"
server_key_iv: "fadce540abf7827b37c89248a6826faf"
server_key_version: "encryptionkey@0"
I20260811 12:43:17.055451 16490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "e4e1eebcdffc40e2af5698dd80305f1b"
format_stamp: "Formatted at 2026-08-11 12:43:17 on dist-test-slave-qg60"
server_key: "3d76f5da281aafe568df43f8f91ef2d7"
server_key_iv: "fadce540abf7827b37c89248a6826faf"
server_key_version: "encryptionkey@0"
I20260811 12:43:17.061203 16490 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 12:43:17.065088 16506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:17.066571 16490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:43:17.066794 16490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "e4e1eebcdffc40e2af5698dd80305f1b"
format_stamp: "Formatted at 2026-08-11 12:43:17 on dist-test-slave-qg60"
server_key: "3d76f5da281aafe568df43f8f91ef2d7"
server_key_iv: "fadce540abf7827b37c89248a6826faf"
server_key_version: "encryptionkey@0"
I20260811 12:43:17.067045 16490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:17.086468 16490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:17.091585 16490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:17.091952 16490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:17.112876 16490 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:38719
I20260811 12:43:17.113073 16571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:38719 every 8 connection(s)
I20260811 12:43:17.114421 16490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:17.118410 16572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:17.120327 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16490
I20260811 12:43:17.120589 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:43:17.121299 745 external_mini_cluster.cc:1428] Setting key 175cdff0023085cf42f569d2d334d8fd
I20260811 12:43:17.126040 16572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:43:17 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:17.151619 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.129826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55962 (local address 127.0.186.126:38719)
0811 12:43:17.130904 (+ 1078us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:17.130928 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:17.131569 (+ 641us) server_negotiation.cc:407] Connection header received
0811 12:43:17.133897 (+ 2328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:17.133904 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:17.134159 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:17.134374 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:17.135766 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.137161 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.138636 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.139233 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.139449 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.143544 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:17.143554 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:17.143571 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:17.143606 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:17.146639 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.147697 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.147704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.147706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.147875 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.148415 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.148419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.148421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.149106 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:17.149275 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:17.150062 (+ 787us) server_negotiation.cc:299] Negotiation successful
0811 12:43:17.150491 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":781,"thread_start_us":520,"threads_started":1}
I20260811 12:43:17.151665 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.129843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38719 (local address 127.0.0.1:55962)
0811 12:43:17.131339 (+ 1496us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.131390 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:17.133479 (+ 2089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:17.134399 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:17.134406 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:17.135192 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:17.135556 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.135575 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.137332 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.137338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.138479 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.138492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.139486 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.139494 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.139663 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.140408 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:17.140432 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:17.143217 (+ 2785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:17.146803 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.146820 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.146837 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.147524 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.148017 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.148025 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.148031 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.148281 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.149267 (+ 986us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:17.149278 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:17.149629 (+ 351us) client_negotiation.cc:769] Sending connection context
0811 12:43:17.149949 (+ 320us) client_negotiation.cc:240] Negotiation successful
0811 12:43:17.150685 (+ 736us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1270,"mutex_wait_us":130,"thread_start_us":913,"threads_started":1}
WARNING: no policy specified for kudu/127.0.186.125@KRBTEST.COM; defaulting to no policy
I20260811 12:43:17.154906 16572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.125@KRBTEST.COM" created.
I20260811 12:43:17.156289 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.155837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53140)
0811 12:43:17.156035 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.156157 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260811 12:43:17.156644 16508 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
I20260811 12:43:17.158370 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.158005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53146)
0811 12:43:17.158152 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.158222 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 12:43:17.158648 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:40201: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab.
Entry for principal kudu/127.0.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab.
I20260811 12:43:17.196388 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:40201
--webserver_interface=127.0.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab
--principal=kudu/127.0.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:38719,127.0.186.125:40201,127.0.186.124:38179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:17.208966 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } attempt: 1
I20260811 12:43:17.210438 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.209801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53156)
0811 12:43:17.210066 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.210254 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 12:43:17.211793 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.211304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53162)
0811 12:43:17.211500 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.211598 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 12:43:17.212034 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:40201: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
I20260811 12:43:17.280315 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } attempt: 2
I20260811 12:43:17.281700 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.281101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53170)
0811 12:43:17.281380 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.281498 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 12:43:17.282884 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.282420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53186)
0811 12:43:17.282595 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.282707 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 12:43:17.283119 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:40201: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
I20260811 12:43:17.374426 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } attempt: 3
I20260811 12:43:17.375907 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.375247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53190)
0811 12:43:17.375528 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.375700 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 12:43:17.377094 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.376641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53198)
0811 12:43:17.376825 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.376912 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 12:43:17.377326 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:40201: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
I20260811 12:43:17.520665 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } attempt: 4
I20260811 12:43:17.522209 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.521470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53214)
0811 12:43:17.521873 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.521999 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
I20260811 12:43:17.523453 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.523005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53220)
0811 12:43:17.523171 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.523289 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 12:43:17.523711 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:40201: Network error: Client connection negotiation failed: client connection to 127.0.186.125:40201: connect: Connection refused (error 111)
W20260811 12:43:17.556035 16581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:17.556344 16581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:17.556442 16581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:17.564128 16581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:17.564260 16581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:17.564361 16581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:17.564481 16581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:17.564574 16581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:17.575171 16581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:38719,127.0.186.125:40201,127.0.186.124:38179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab
--principal=kudu/127.0.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:40201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:17.576675 16581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:17.578114 16581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:17.590826 16587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:17.590888 16589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:17.591447 16591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:17.592267 16581 server_base.cc:1034] running on GCE node
I20260811 12:43:17.593241 16581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:17.594820 16581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:17.596091 16581 hybrid_clock.cc:648] HybridClock initialized: now 1786452197595967 us; error 105 us; skew 500 ppm
I20260811 12:43:17.596483 16581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:17 dist-test-slave-qg60 krb5kdc[16475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:17.600191 16581 init.cc:377] Logged in from keytab as kudu/127.0.186.125@KRBTEST.COM (short username kudu)
I20260811 12:43:17.601962 16581 webserver.cc:460] Webserver started at http://127.0.186.125:34203/ using document root <none> and password file <none>
I20260811 12:43:17.602739 16581 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:17.602903 16581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:17.603247 16581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:17.606673 16581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data/instance:
uuid: "c229af9e7cfc4870ae3ba7b7673cf47a"
format_stamp: "Formatted at 2026-08-11 12:43:17 on dist-test-slave-qg60"
server_key: "34b5ffcd84290ed5ae2ebeb4927e5529"
server_key_iv: "a6dc40dceceb6449650a07a7b6fa1aae"
server_key_version: "encryptionkey@0"
I20260811 12:43:17.607667 16581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal/instance:
uuid: "c229af9e7cfc4870ae3ba7b7673cf47a"
format_stamp: "Formatted at 2026-08-11 12:43:17 on dist-test-slave-qg60"
server_key: "34b5ffcd84290ed5ae2ebeb4927e5529"
server_key_iv: "a6dc40dceceb6449650a07a7b6fa1aae"
server_key_version: "encryptionkey@0"
I20260811 12:43:17.613730 16581 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 12:43:17.617842 16599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:17.619386 16581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:43:17.619690 16581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal
uuid: "c229af9e7cfc4870ae3ba7b7673cf47a"
format_stamp: "Formatted at 2026-08-11 12:43:17 on dist-test-slave-qg60"
server_key: "34b5ffcd84290ed5ae2ebeb4927e5529"
server_key_iv: "a6dc40dceceb6449650a07a7b6fa1aae"
server_key_version: "encryptionkey@0"
I20260811 12:43:17.619958 16581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:17.633159 16581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:17.637876 16581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:17.638182 16581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:17.658699 16581 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.125:40201
I20260811 12:43:17.658753 16658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.125:40201 every 8 connection(s)
I20260811 12:43:17.660219 16581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
I20260811 12:43:17.663486 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16581
I20260811 12:43:17.663734 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-1/wal/instance
I20260811 12:43:17.664207 745 external_mini_cluster.cc:1428] Setting key 1e9fd5e7ae0324ff8404949eb8547f03
I20260811 12:43:17.664530 16659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:17.672372 16659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:43:17 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.186.124@KRBTEST.COM; defaulting to no policy
I20260811 12:43:17.699611 16661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.675513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55972 (local address 127.0.186.126:38719)
0811 12:43:17.676125 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:17.676130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:17.677497 (+ 1367us) server_negotiation.cc:407] Connection header received
0811 12:43:17.680637 (+ 3140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:17.680642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:17.680715 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:17.680926 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:17.683280 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.684105 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.686752 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.687185 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.687288 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.691981 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:17.691991 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:17.692000 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:17.692059 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:17.695573 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.696787 (+ 1214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.696793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.696797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.696935 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.697508 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.697512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.697514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.697812 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:17.697920 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:17.698918 (+ 998us) server_negotiation.cc:299] Negotiation successful
0811 12:43:17.699103 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":340,"threads_started":1}
I20260811 12:43:17.700662 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.676171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38719 (local address 127.0.0.1:55972)
0811 12:43:17.677270 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.677334 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:17.680304 (+ 2970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:17.681212 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:17.681226 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:17.682204 (+ 978us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:17.683069 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.683098 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.684286 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.684294 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.686558 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.686577 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.687445 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.687455 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.687800 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.688608 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:17.688660 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:17.691699 (+ 3039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:17.695759 (+ 4060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.695774 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.695797 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.696594 (+ 797us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.697072 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.697080 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.697084 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.697374 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.697974 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:17.697986 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:17.698549 (+ 563us) client_negotiation.cc:769] Sending connection context
0811 12:43:17.698810 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 12:43:17.699308 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"thread_start_us":560,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.124@KRBTEST.COM" created.
I20260811 12:43:17.702877 16659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:43:17 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:43:17.721369 16664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.704081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53224 (local address 127.0.186.125:40201)
0811 12:43:17.704932 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:17.704942 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:17.704976 (+ 34us) server_negotiation.cc:407] Connection header received
0811 12:43:17.705039 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:17.705050 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:17.705296 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:17.705459 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:17.706242 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.707954 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.709389 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.710556 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.710766 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.714424 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:17.714443 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:17.714464 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:17.714510 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:17.717738 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.718740 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.718747 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.718749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.718873 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.719476 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.719480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.719482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.719869 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:17.720047 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:17.720563 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 12:43:17.721020 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":266,"server-negotiator.queue_time_us":619,"thread_start_us":460,"threads_started":1}
I20260811 12:43:17.721481 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.703882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53224)
0811 12:43:17.704175 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.704198 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:17.704329 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:17.705468 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:17.705473 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:17.705895 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:17.706065 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.706074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.708120 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.708125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.709238 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.709253 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.710785 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.710791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.711018 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.711824 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:17.711844 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:17.714172 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:17.717912 (+ 3740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.717921 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.717929 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.718578 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.719076 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.719085 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.719092 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.719327 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.720020 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:17.720029 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:17.720222 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 12:43:17.720412 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 12:43:17.720893 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":38}
I20260811 12:43:17.724519 16659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:43:17.726080 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.725419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36936)
0811 12:43:17.725678 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.725841 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260811 12:43:17.726364 16600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:17.728245 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.727720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36938)
0811 12:43:17.727942 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.728071 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 12:43:17.728535 16659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab.
Entry for principal kudu/127.0.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab.
I20260811 12:43:17.745847 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:38179
--webserver_interface=127.0.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab
--principal=kudu/127.0.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:38719,127.0.186.125:40201,127.0.186.124:38179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:17.778021 16659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 1
I20260811 12:43:17.779386 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.778859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36954)
0811 12:43:17.779107 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.779221 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 12:43:17.780500 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.780090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36964)
0811 12:43:17.780311 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.780383 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260811 12:43:17.780752 16659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:17.823024 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } attempt: 5
Aug 11 12:43:17 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:43:17.839242 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.823885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53238)
0811 12:43:17.824126 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.824160 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:17.824310 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:17.824809 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:17.824813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:17.825253 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:17.825464 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.825474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.826939 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.826943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.827819 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:17.827832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.828902 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.828906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:17.829047 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.829738 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:17.829757 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:17.832107 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:17.836123 (+ 4016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.836127 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.836131 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.836521 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.837024 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:17.837028 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:17.837030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:17.837181 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:17.838047 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:17.838055 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:17.838278 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 12:43:17.838457 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 12:43:17.838868 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 12:43:17.840334 16664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.824170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53238 (local address 127.0.186.125:40201)
0811 12:43:17.824379 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:17.824385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:17.824408 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:43:17.824482 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:17.824488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:17.824589 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:17.824703 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:17.825631 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.826790 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.827971 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:17.828658 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:17.828835 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:17.832338 (+ 3503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:17.832346 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:17.832354 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:17.832405 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:17.835963 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.836665 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.836674 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.836679 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.836882 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:17.837384 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:17.837392 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:17.837397 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:17.837858 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:17.839546 (+ 1688us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:17.839709 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 12:43:17.839972 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:43:17.841602 16572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:43:17.842803 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.842374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36976)
0811 12:43:17.842553 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.842644 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 12:43:17.843874 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.843541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36988)
0811 12:43:17.843697 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.843774 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 12:43:17.844163 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:17.848994 16659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 2
I20260811 12:43:17.850073 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.849625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:36994)
0811 12:43:17.849826 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.849922 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 12:43:17.851482 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.851029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37004)
0811 12:43:17.851256 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.851338 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 12:43:17.851729 16659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:17.895406 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 1
I20260811 12:43:17.896787 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.896221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37008)
0811 12:43:17.896434 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.896540 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 12:43:17.897886 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.897521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37020)
0811 12:43:17.897695 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.897769 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 12:43:17.898104 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:17.942988 16659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 3
I20260811 12:43:17.944252 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.943774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37034)
0811 12:43:17.943980 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.944085 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 12:43:17.945405 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.944959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37046)
0811 12:43:17.945194 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.945287 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260811 12:43:17.945604 16659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:17.966356 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 2
I20260811 12:43:17.967754 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.967189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37056)
0811 12:43:17.967481 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.967577 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 12:43:17.969101 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:17.968637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37070)
0811 12:43:17.968859 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:17.968964 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 12:43:17.969489 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:18.075800 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 3
I20260811 12:43:18.077613 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.076938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37076)
0811 12:43:18.077264 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.077394 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260811 12:43:18.079161 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.078632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37082)
0811 12:43:18.078880 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.078983 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260811 12:43:18.079604 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:18.088860 16659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 4
I20260811 12:43:18.090106 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.089611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37090)
0811 12:43:18.089845 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.089945 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 12:43:18.091131 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.090794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37106)
0811 12:43:18.090949 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.091028 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 12:43:18.091333 16659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
W20260811 12:43:18.138909 16667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:18.139286 16667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:18.139391 16667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:18.146860 16667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:18.146991 16667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:18.147039 16667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:18.147091 16667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:18.147142 16667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:18.157580 16667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:38719,127.0.186.125:40201,127.0.186.124:38179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab
--principal=kudu/127.0.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:38179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:18.159010 16667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:18.160333 16667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:18.173527 16674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:18.173588 16677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:18.173627 16675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:18.178685 16667 server_base.cc:1034] running on GCE node
I20260811 12:43:18.179754 16667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:18.181596 16667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:18.182853 16667 hybrid_clock.cc:648] HybridClock initialized: now 1786452198182803 us; error 44 us; skew 500 ppm
I20260811 12:43:18.183251 16667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452198, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:18.187036 16667 init.cc:377] Logged in from keytab as kudu/127.0.186.124@KRBTEST.COM (short username kudu)
I20260811 12:43:18.188933 16667 webserver.cc:460] Webserver started at http://127.0.186.124:37607/ using document root <none> and password file <none>
I20260811 12:43:18.189769 16667 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:18.189934 16667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:18.190332 16667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:18.193919 16667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data/instance:
uuid: "f0f6e00eeac9420ca87b2b289aa52e34"
format_stamp: "Formatted at 2026-08-11 12:43:18 on dist-test-slave-qg60"
server_key: "55dd95304fdd742e9a57491920c1df8d"
server_key_iv: "b8d08339c796fe9115a22b00464432b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:18.194877 16667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal/instance:
uuid: "f0f6e00eeac9420ca87b2b289aa52e34"
format_stamp: "Formatted at 2026-08-11 12:43:18 on dist-test-slave-qg60"
server_key: "55dd95304fdd742e9a57491920c1df8d"
server_key_iv: "b8d08339c796fe9115a22b00464432b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:18.200935 16667 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 12:43:18.204986 16686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:18.206575 16667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:43:18.206799 16667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal
uuid: "f0f6e00eeac9420ca87b2b289aa52e34"
format_stamp: "Formatted at 2026-08-11 12:43:18 on dist-test-slave-qg60"
server_key: "55dd95304fdd742e9a57491920c1df8d"
server_key_iv: "b8d08339c796fe9115a22b00464432b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:18.207057 16667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:18.246773 16667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:18.252087 16667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:18.252450 16667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:18.257136 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 4
I20260811 12:43:18.258304 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.257869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37116)
0811 12:43:18.258070 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.258166 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 12:43:18.259615 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.259221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37122)
0811 12:43:18.259394 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.259483 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 12:43:18.260022 16572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:38179: Network error: Client connection negotiation failed: client connection to 127.0.186.124:38179: connect: Connection refused (error 111)
I20260811 12:43:18.273381 16667 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.124:38179
I20260811 12:43:18.273401 16751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.124:38179 every 8 connection(s)
I20260811 12:43:18.275008 16667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
I20260811 12:43:18.278900 16753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:18.280447 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16667
I20260811 12:43:18.280715 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786451972721996-745-0/minicluster-data/master-2/wal/instance
I20260811 12:43:18.281315 745 external_mini_cluster.cc:1428] Setting key 7ff7bf1a65f75e04b07d63330aebf5a7
I20260811 12:43:18.286696 16753 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452198, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:18.304946 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.289948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55978 (local address 127.0.186.126:38719)
0811 12:43:18.290563 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.290571 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.291018 (+ 447us) server_negotiation.cc:407] Connection header received
0811 12:43:18.291232 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.291239 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.291318 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.291435 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.292557 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.293332 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.294700 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.295110 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.295259 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.298891 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.298897 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.298900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.298937 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.301906 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.302632 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.302639 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.302642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.302777 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.303209 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.303215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.303219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.303501 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.303675 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.304229 (+ 554us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.304464 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":261,"threads_started":1}
I20260811 12:43:18.306046 16756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.283398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37126 (local address 127.0.186.124:38179)
0811 12:43:18.284427 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.284439 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.284486 (+ 47us) server_negotiation.cc:407] Connection header received
0811 12:43:18.286404 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.286427 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.286841 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.287228 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.289345 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.291428 (+ 2083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.293069 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.293748 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.293946 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.298671 (+ 4725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.298679 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.298692 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.298724 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.301684 (+ 2960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.302431 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.302438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.302440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.302611 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.303029 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.303032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.303035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.303587 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.303923 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.304297 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.304876 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":793,"thread_start_us":528,"threads_started":1}
I20260811 12:43:18.306093 16758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.290050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38719 (local address 127.0.0.1:55978)
0811 12:43:18.290886 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.290924 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:18.291102 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:18.291510 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:18.291517 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:18.292124 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:18.292402 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.292412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.293500 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.293504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.294546 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.294558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.295338 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.295345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.295517 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.296175 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:18.296197 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:18.298669 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:18.302051 (+ 3382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.302064 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.302076 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.302508 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.302895 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.302899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.302903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.303091 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.303636 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:18.303644 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:18.303861 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 12:43:18.304128 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 12:43:18.304872 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":198,"thread_start_us":464,"threads_started":1}
I20260811 12:43:18.307865 16753 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452198, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:18.323459 16758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.308992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:40201 (local address 127.0.0.1:53252)
0811 12:43:18.309205 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.309229 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:18.309340 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:18.309724 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:18.309729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:18.310157 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:18.310302 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.310311 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.311507 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.311515 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.312569 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.312582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.313385 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.313391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.313645 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.314274 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:18.314292 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:18.316890 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:18.320281 (+ 3391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.320288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.320295 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.320927 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.321397 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.321403 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.321409 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.321669 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.322299 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:18.322307 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:18.322545 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 12:43:18.322740 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 12:43:18.323082 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 12:43:18.323588 16664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.309147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53252 (local address 127.0.186.125:40201)
0811 12:43:18.309348 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.309355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.309378 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:43:18.309448 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.309456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.309544 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.309683 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.310463 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.311354 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.312750 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.313224 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.313376 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.317105 (+ 3729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.317110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.317114 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.317148 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.320130 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.321060 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.321069 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.321074 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.321265 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.321808 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.321812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.321814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.322157 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.322284 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.322841 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.323167 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 12:43:18.324570 16753 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:43:18.326637 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.309657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55990 (local address 127.0.186.126:38719)
0811 12:43:18.309844 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.309848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.309861 (+ 13us) server_negotiation.cc:407] Connection header received
0811 12:43:18.309898 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.309901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.309968 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.310075 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.311530 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.312314 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.313710 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.314325 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.314474 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.319159 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.319165 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.319168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.319203 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.322854 (+ 3651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.324220 (+ 1366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.324225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.324227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.324408 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.324875 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.324880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.324885 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.325280 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.325630 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.325976 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.326262 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452198, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:43:18.339164 16758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.325533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37132)
0811 12:43:18.325820 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.325842 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:18.325960 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:18.326326 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:18.326332 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:18.326860 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:18.327062 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.327075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.328427 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.328431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.329514 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.329526 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.330262 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.330267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.330531 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.331144 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:18.331161 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:18.333250 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:18.336837 (+ 3587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.336843 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.336856 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.337223 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.337602 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.337607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.337611 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.337739 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.338247 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:18.338252 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:18.338426 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 12:43:18.338582 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 12:43:18.338865 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":5}
I20260811 12:43:18.339641 16756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.325482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37132 (local address 127.0.186.124:38179)
0811 12:43:18.325696 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.325703 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.325925 (+ 222us) server_negotiation.cc:407] Connection header received
0811 12:43:18.326083 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.326091 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.326172 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.326269 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.327237 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.328286 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.329657 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.330120 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.330252 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.333453 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.333457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.333460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.333489 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.336163 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.337349 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.337354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.337358 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.337493 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.337852 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.337857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.337860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.338130 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.338284 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.338773 (+ 489us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.339052 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":88}
I20260811 12:43:18.344417 16664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.329012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53258 (local address 127.0.186.125:40201)
0811 12:43:18.329190 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.329194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.329208 (+ 14us) server_negotiation.cc:407] Connection header received
0811 12:43:18.329248 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.329251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.329301 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.329410 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.330720 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.331437 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.332811 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.333259 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.333405 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.337906 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.337911 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.337918 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.337953 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.341676 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.342418 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.342431 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.342434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.342580 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.342968 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.342974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.342977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.343256 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.343559 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.343844 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.344093 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:43:18.345525 16753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: Bootstrap starting.
I20260811 12:43:18.349779 16753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:18.350169 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:43:18.351347 16753 log.cc:824] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:18.355299 16753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: No bootstrap required, opened a new log
I20260811 12:43:18.373785 16753 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.374351 16753 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:18.374521 16753 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f6e00eeac9420ca87b2b289aa52e34, State: Initialized, Role: FOLLOWER
I20260811 12:43:18.375247 16753 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.381060 16768 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.381439 16768 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:43:18.382206 16753 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:18.392789 16659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 5
W20260811 12:43:18.399693 16779 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 12:43:18.404249 16664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.357265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53264 (local address 127.0.186.125:40201)
0811 12:43:18.357428 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.357434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.369814 (+ 12380us) server_negotiation.cc:407] Connection header received
0811 12:43:18.370310 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.370339 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.370457 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.370601 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.373737 (+ 3136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.375040 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.378093 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.378841 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.378993 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.395857 (+ 16864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.395866 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.395872 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.395931 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.400062 (+ 4131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.401023 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.401029 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.401032 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.401221 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.401753 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.401758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.401761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.402189 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.402500 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.403605 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.403869 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 12:43:18.404812 16779 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:43:18.389868 16667 master_runner.cc:186] Error getting master registration for 127.0.186.126:38719: OK, instance_id { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" instance_seqno: 1786452197106793 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 12:43:18.405128 16667 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 12:43:18.408183 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.356750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55996 (local address 127.0.186.126:38719)
0811 12:43:18.357461 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.357486 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.370569 (+ 13083us) server_negotiation.cc:407] Connection header received
0811 12:43:18.370745 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.370755 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.370850 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.370956 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.373809 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.375053 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.378212 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.378949 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.379060 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.393410 (+ 14350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.393420 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.393429 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.393507 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.403932 (+ 10425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.405090 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.405096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.405099 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.405276 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.405748 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.405753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.405756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.406167 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.406429 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.407573 (+ 1144us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.407819 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583}
I20260811 12:43:18.409091 16756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.357127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37144 (local address 127.0.186.124:38179)
0811 12:43:18.357305 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.357310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.370097 (+ 12787us) server_negotiation.cc:407] Connection header received
0811 12:43:18.370413 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.370419 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.370519 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.370617 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.373624 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.374732 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.378197 (+ 3465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.379221 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.379348 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.393570 (+ 14222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.393577 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.393581 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.393624 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.402196 (+ 8572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.406375 (+ 4179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.406383 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.406387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.406569 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.407070 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.407075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.407079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.407551 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.407809 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.408408 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.408651 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:43:18.422681 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.394774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37152)
0811 12:43:18.394956 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.394991 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:18.395111 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:18.405898 (+ 10787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:18.405906 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:18.406430 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:18.406646 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.406660 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.408478 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.408484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.409994 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.410011 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.411152 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.411162 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.411399 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.412265 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:18.412281 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:18.415263 (+ 2982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:18.419558 (+ 4295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.419566 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.419573 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.420138 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.420570 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.420576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.420580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.420783 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.421575 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:18.421580 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:18.421762 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 12:43:18.421925 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 12:43:18.422264 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 12:43:18.422722 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.395193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37152 (local address 127.0.186.124:38179)
0811 12:43:18.405606 (+ 10413us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.405611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.405630 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:43:18.405673 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.405676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.405731 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.405865 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.406882 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.408293 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.410202 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.410977 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.411123 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.415547 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.415558 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.415563 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.415608 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.419401 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.420282 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.420286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.420288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.420442 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.420970 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.420975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.420977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.421375 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.421515 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.422139 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.422321 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10301,"thread_start_us":10094,"threads_started":1}
I20260811 12:43:18.428609 16659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: Bootstrap starting.
I20260811 12:43:18.432377 16659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:18.433684 16659 log.cc:824] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:18.437086 16659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: No bootstrap required, opened a new log
I20260811 12:43:18.445783 16659 raft_consensus.cc:348] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.446154 16659 raft_consensus.cc:374] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:18.446331 16659 raft_consensus.cc:729] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c229af9e7cfc4870ae3ba7b7673cf47a, State: Initialized, Role: FOLLOWER
I20260811 12:43:18.447022 16659 consensus_queue.cc:260] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.448082 16783 sys_catalog.cc:455] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.448555 16783 sys_catalog.cc:458] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:43:18.449455 16659 sys_catalog.cc:564] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:43:18.468999 16794 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:43:18.469353 16794 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:43:18.459056 16581 master_runner.cc:186] Error getting master registration for 127.0.186.126:38719: OK, instance_id { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" instance_seqno: 1786452197106793 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 12:43:18.473461 16581 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 12:43:18.504928 16694 tablet.cc:2369] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:18.520833 16768 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:18.521196 16768 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.523056 16768 leader_election.cc:288] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4e1eebcdffc40e2af5698dd80305f1b (127.0.186.126:38719), c229af9e7cfc4870ae3ba7b7673cf47a (127.0.186.125:40201)
I20260811 12:43:18.524204 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" is_pre_election: true
I20260811 12:43:18.524917 16630 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f6e00eeac9420ca87b2b289aa52e34 in term 0.
I20260811 12:43:18.525607 16688 leader_election.cc:302] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c229af9e7cfc4870ae3ba7b7673cf47a, f0f6e00eeac9420ca87b2b289aa52e34; no voters:
I20260811 12:43:18.526093 16768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:43:18.526266 16768 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:43:18.526373 16768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:18.529992 16768 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.531352 16768 leader_election.cc:288] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [CANDIDATE]: Term 1 election: Requested vote from peers e4e1eebcdffc40e2af5698dd80305f1b (127.0.186.126:38719), c229af9e7cfc4870ae3ba7b7673cf47a (127.0.186.125:40201)
I20260811 12:43:18.532009 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a"
I20260811 12:43:18.532259 16630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:18.535981 16630 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f6e00eeac9420ca87b2b289aa52e34 in term 1.
I20260811 12:43:18.537264 16572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } attempt: 5
I20260811 12:43:18.540254 16688 leader_election.cc:302] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c229af9e7cfc4870ae3ba7b7673cf47a, f0f6e00eeac9420ca87b2b289aa52e34; no voters:
I20260811 12:43:18.541038 16768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 1 FOLLOWER]: Leader election won for term 1
Aug 11 12:43:18 dist-test-slave-qg60 krb5kdc[16475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:43:18.556656 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.537831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:38179 (local address 127.0.0.1:37168)
0811 12:43:18.538195 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:18.538217 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:18.538330 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:18.539139 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:18.539146 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:18.539666 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:18.539892 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.539906 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.541450 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.541456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.542985 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:18.543002 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.544252 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.544258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:18.544468 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.545241 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:18.545267 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:18.548511 (+ 3244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:18.553473 (+ 4962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.553479 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.553484 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.554020 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.554506 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:18.554512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:18.554516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:18.554716 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:18.555520 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:18.555528 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:18.555693 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 12:43:18.555852 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 12:43:18.556154 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223}
I20260811 12:43:18.557721 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:18.538553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37168 (local address 127.0.186.124:38179)
0811 12:43:18.538737 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:18.538743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:18.538761 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:43:18.538814 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:18.538819 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:18.538909 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:18.539003 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:18.540068 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.541267 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.543180 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:18.543897 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:18.544019 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:18.548760 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:18.548768 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:18.548773 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:18.548815 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:18.553145 (+ 4330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.554185 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.554195 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.554199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.554345 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:18.554854 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:18.554859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:18.554863 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:18.555293 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:18.555451 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:18.557112 (+ 1661us) server_negotiation.cc:299] Negotiation successful
0811 12:43:18.557354 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 12:43:18.563970 16572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: Bootstrap starting.
I20260811 12:43:18.570132 16572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:18.572064 16572 log.cc:824] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:18.575845 16768 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [term 1 LEADER]: Becoming Leader. State: Replica: f0f6e00eeac9420ca87b2b289aa52e34, State: Running, Role: LEADER
I20260811 12:43:18.577325 16768 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.579608 16572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: No bootstrap required, opened a new log
I20260811 12:43:18.593732 16572 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.594352 16572 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:18.594560 16572 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4e1eebcdffc40e2af5698dd80305f1b, State: Initialized, Role: FOLLOWER
I20260811 12:43:18.594435 16797 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0f6e00eeac9420ca87b2b289aa52e34. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.594884 16797 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:18.595680 16572 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } }
I20260811 12:43:18.614617 16801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:18.619362 16801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:18.625771 16572 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:18.625835 16539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4e1eebcdffc40e2af5698dd80305f1b"
I20260811 12:43:18.625849 16540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" is_pre_election: true
I20260811 12:43:18.626575 16540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f6e00eeac9420ca87b2b289aa52e34 in term 0.
I20260811 12:43:18.625237 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.629421 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: This master's current role is: FOLLOWER
W20260811 12:43:18.646607 16606 tablet.cc:2369] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:18.656641 16630 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [term 1 FOLLOWER]: Refusing update from remote peer f0f6e00eeac9420ca87b2b289aa52e34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:18.657707 16540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:18.661589 16768 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:18.669232 16540 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [term 1 FOLLOWER]: Refusing update from remote peer f0f6e00eeac9420ca87b2b289aa52e34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:18.670302 16768 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:18.692647 16783 sys_catalog.cc:455] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0f6e00eeac9420ca87b2b289aa52e34. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.693562 16783 sys_catalog.cc:458] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:43:18.697831 16768 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.698451 16768 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:18.699349 16801 catalog_manager.cc:1347] Generated new cluster ID: 5302908ce6644f4f8e617ce031fc0370
I20260811 12:43:18.699453 16801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:18.704917 16814 mvcc.cc:205] Tried to move back new op lower bound from 7317308205675872256 to 7317308205385216000. Current Snapshot: MvccSnapshot[applied={T|T < 7317308205675872256}]
I20260811 12:43:18.706442 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0f6e00eeac9420ca87b2b289aa52e34. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.706817 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:43:18.708669 16768 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.709013 16768 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:18.713860 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.714171 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:43:18.718102 16783 sys_catalog.cc:455] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4e1eebcdffc40e2af5698dd80305f1b" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38719 } } peers { permanent_uuid: "c229af9e7cfc4870ae3ba7b7673cf47a" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 40201 } } peers { permanent_uuid: "f0f6e00eeac9420ca87b2b289aa52e34" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 38179 } } }
I20260811 12:43:18.718390 16783 sys_catalog.cc:458] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:43:18.723624 16818 mvcc.cc:205] Tried to move back new op lower bound from 7317308205675872256 to 7317308205385216000. Current Snapshot: MvccSnapshot[applied={T|T < 7317308205675872256 or (T in {7317308205675872256})}]
I20260811 12:43:18.760066 16801 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:43:18.761970 16801 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:18.763391 16825 catalog_manager.cc:1259] Loaded cluster ID: 5302908ce6644f4f8e617ce031fc0370
I20260811 12:43:18.763500 16825 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: loading cluster ID for follower catalog manager: success
I20260811 12:43:18.773681 16825 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: acquiring CA information for follower catalog manager: success
I20260811 12:43:18.774978 16801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34: Generated new TSK 0
W20260811 12:43:18.775234 16825 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 12:43:18.776039 16801 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:43:19.471623 16794 catalog_manager.cc:1259] Loaded cluster ID: 5302908ce6644f4f8e617ce031fc0370
I20260811 12:43:19.471784 16794 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: loading cluster ID for follower catalog manager: success
I20260811 12:43:19.474443 16794 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: acquiring CA information for follower catalog manager: success
I20260811 12:43:19.476413 16794 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c229af9e7cfc4870ae3ba7b7673cf47a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:43:19.778290 16825 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e4e1eebcdffc40e2af5698dd80305f1b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:43:19.928807 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16490
I20260811 12:43:19.930264 16565 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:20.046259 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16490
I20260811 12:43:20.074615 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16581
I20260811 12:43:20.075798 16654 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:20.111794 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:20.110827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38719 (local address 127.0.0.1:55998)
0811 12:43:20.111491 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:20.111626 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:38719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":427,"threads_started":1}
W20260811 12:43:20.112193 16690 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.126:38719: connect: Connection refused (error 111)
I20260811 12:43:20.113760 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:20.113372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38719 (local address 127.0.0.1:56010)
0811 12:43:20.113549 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:20.113635 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:38719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 12:43:20.113971 16690 consensus_peers.cc:487] T 00000000000000000000000000000000 P f0f6e00eeac9420ca87b2b289aa52e34 -> Peer e4e1eebcdffc40e2af5698dd80305f1b (127.0.186.126:38719): Couldn't send request to peer e4e1eebcdffc40e2af5698dd80305f1b. Status: Network error: Client connection negotiation failed: client connection to 127.0.186.126:38719: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 12:43:20.199406 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16581
I20260811 12:43:20.224781 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16667
I20260811 12:43:20.226166 16746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:20.340524 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16667
2026-08-11T12:43:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5306 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:43:20 dist-test-slave-qg60 krb5kdc[16843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:43:20 dist-test-slave-qg60 krb5kdc[16843](info): set up 2 sockets
Aug 11 12:43:20 dist-test-slave-qg60 krb5kdc[16843](info): commencing operation
krb5kdc: starting...
W20260811 12:43:21.569119 745 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:43:21 dist-test-slave-qg60 krb5kdc[16843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:43:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:43:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:43:21.905048 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:33645
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:33645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:22.256040 16858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:22.256414 16858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:22.256596 16858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:22.264254 16858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:22.264428 16858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:22.264554 16858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:22.264674 16858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:22.264783 16858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:22.275342 16858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:33645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:33645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:22.276923 16858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:22.278334 16858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:22.290884 16863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:22.290987 16864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:22.291464 16866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:22.292233 16858 server_base.cc:1034] running on GCE node
I20260811 12:43:22.293205 16858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:22.294811 16858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:22.296087 16858 hybrid_clock.cc:648] HybridClock initialized: now 1786452202296025 us; error 67 us; skew 500 ppm
I20260811 12:43:22.296591 16858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:22 dist-test-slave-qg60 krb5kdc[16843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452202, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:22.299901 16858 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:22.301645 16858 webserver.cc:460] Webserver started at http://127.0.186.126:42129/ using document root <none> and password file <none>
I20260811 12:43:22.302388 16858 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:22.302546 16858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:22.302891 16858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:22.306143 16858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "1c9dcd67c97b433ab42e58f299f3c099"
format_stamp: "Formatted at 2026-08-11 12:43:22 on dist-test-slave-qg60"
server_key: "fc8acfc781d06f89600caa798dad3312"
server_key_iv: "87c1cb799d903e0cb08b97791246814b"
server_key_version: "encryptionkey@0"
I20260811 12:43:22.306967 16858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "1c9dcd67c97b433ab42e58f299f3c099"
format_stamp: "Formatted at 2026-08-11 12:43:22 on dist-test-slave-qg60"
server_key: "fc8acfc781d06f89600caa798dad3312"
server_key_iv: "87c1cb799d903e0cb08b97791246814b"
server_key_version: "encryptionkey@0"
I20260811 12:43:22.312645 16858 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 12:43:22.316227 16876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:22.317617 16858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 12:43:22.317837 16858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "1c9dcd67c97b433ab42e58f299f3c099"
format_stamp: "Formatted at 2026-08-11 12:43:22 on dist-test-slave-qg60"
server_key: "fc8acfc781d06f89600caa798dad3312"
server_key_iv: "87c1cb799d903e0cb08b97791246814b"
server_key_version: "encryptionkey@0"
I20260811 12:43:22.318063 16858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:22.339344 16858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:22.343827 16858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:22.344151 16858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:22.364236 16858 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:33645
I20260811 12:43:22.364269 16932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:33645 every 8 connection(s)
I20260811 12:43:22.365796 16858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:22.368220 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16858
I20260811 12:43:22.368484 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:43:22.369469 745 external_mini_cluster.cc:1428] Setting key d6a0e5edabfa45a34a268053a7871938
I20260811 12:43:22.370779 16933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:43:22 dist-test-slave-qg60 krb5kdc[16843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:22.386315 16933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099: Bootstrap starting.
I20260811 12:43:22.389925 16933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:22.390992 16933 log.cc:824] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:22.394861 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:22.371519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34676 (local address 127.0.186.126:33645)
0811 12:43:22.372376 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:22.372388 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:22.372432 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:43:22.374173 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:22.374196 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:22.374605 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:22.374961 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:22.376961 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:22.378368 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:22.380359 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:22.381137 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:22.381269 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:22.386490 (+ 5221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:22.386502 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:22.386524 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:22.386575 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:22.389823 (+ 3248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:22.390628 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:22.390635 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:22.390641 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:22.390822 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:22.391261 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:22.391266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:22.391269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:22.392063 (+ 794us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:22.392316 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:22.392980 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 12:43:22.393445 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":408,"threads_started":1}
I20260811 12:43:22.394954 16933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099: No bootstrap required, opened a new log
I20260811 12:43:22.398970 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:43:22.404547 16933 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c9dcd67c97b433ab42e58f299f3c099" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 33645 } }
I20260811 12:43:22.405055 16933 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:22.405180 16933 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9dcd67c97b433ab42e58f299f3c099, State: Initialized, Role: FOLLOWER
I20260811 12:43:22.405716 16933 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c9dcd67c97b433ab42e58f299f3c099" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 33645 } }
I20260811 12:43:22.405922 16933 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:22.406029 16933 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:22.406173 16933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:22.408360 16933 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c9dcd67c97b433ab42e58f299f3c099" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 33645 } }
I20260811 12:43:22.408919 16933 leader_election.cc:302] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c9dcd67c97b433ab42e58f299f3c099; no voters:
I20260811 12:43:22.409513 16933 leader_election.cc:288] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:43:22.409693 16939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:22.410413 16939 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [term 1 LEADER]: Becoming Leader. State: Replica: 1c9dcd67c97b433ab42e58f299f3c099, State: Running, Role: LEADER
I20260811 12:43:22.410931 16939 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c9dcd67c97b433ab42e58f299f3c099" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 33645 } }
I20260811 12:43:22.411706 16933 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:22.414254 16942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c9dcd67c97b433ab42e58f299f3c099. Latest consensus state: current_term: 1 leader_uuid: "1c9dcd67c97b433ab42e58f299f3c099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c9dcd67c97b433ab42e58f299f3c099" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 33645 } } }
I20260811 12:43:22.414374 16940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c9dcd67c97b433ab42e58f299f3c099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c9dcd67c97b433ab42e58f299f3c099" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 33645 } } }
I20260811 12:43:22.414770 16940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:22.414772 16942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099 [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:22.416438 16951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:22.421042 16951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:22.431150 16951 catalog_manager.cc:1347] Generated new cluster ID: 3bed7e41aba34033bf7306294e676e09
I20260811 12:43:22.431275 16951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:22.443692 16951 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:43:22.445706 16951 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:22.456431 16951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c9dcd67c97b433ab42e58f299f3c099: Generated new TSK 0
I20260811 12:43:22.457638 16951 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:43:22.513530 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16858
I20260811 12:43:22.514901 16928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:22.616115 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16858
2026-08-11T12:43:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2271 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:43:22 dist-test-slave-qg60 krb5kdc[16967](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:43:22 dist-test-slave-qg60 krb5kdc[16967](info): set up 2 sockets
Aug 11 12:43:22 dist-test-slave-qg60 krb5kdc[16967](info): commencing operation
krb5kdc: starting...
W20260811 12:43:23.849630 745 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.007s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:43:24 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:43:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:43:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:43:24.193974 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34025
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:34025
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:24.556857 16985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:24.557176 16985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:24.557366 16985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:24.564992 16985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:24.565122 16985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:24.565217 16985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:24.565301 16985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:24.565371 16985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:24.575783 16985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:34025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:24.577404 16985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:24.578864 16985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:24.591120 16991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:24.591185 16992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:24.591185 16994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:24.592383 16985 server_base.cc:1034] running on GCE node
I20260811 12:43:24.593259 16985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:24.594735 16985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:24.595986 16985 hybrid_clock.cc:648] HybridClock initialized: now 1786452204595948 us; error 47 us; skew 500 ppm
I20260811 12:43:24.596359 16985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:24 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452204, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:24.606762 16985 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:24.608551 16985 webserver.cc:460] Webserver started at http://127.0.186.126:35019/ using document root <none> and password file <none>
I20260811 12:43:24.609395 16985 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:24.609517 16985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:24.609817 16985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:24.613265 16985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "16269073447244499cabb54331e8a21f"
format_stamp: "Formatted at 2026-08-11 12:43:24 on dist-test-slave-qg60"
server_key: "8f6231ccf3899e6047d7e218200d2c40"
server_key_iv: "0aecc91d3001e2d1a16526535369f0b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:24.614110 16985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "16269073447244499cabb54331e8a21f"
format_stamp: "Formatted at 2026-08-11 12:43:24 on dist-test-slave-qg60"
server_key: "8f6231ccf3899e6047d7e218200d2c40"
server_key_iv: "0aecc91d3001e2d1a16526535369f0b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:24.620193 16985 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 12:43:24.623955 17001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:24.625586 16985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:43:24.625748 16985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "16269073447244499cabb54331e8a21f"
format_stamp: "Formatted at 2026-08-11 12:43:24 on dist-test-slave-qg60"
server_key: "8f6231ccf3899e6047d7e218200d2c40"
server_key_iv: "0aecc91d3001e2d1a16526535369f0b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:24.625931 16985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:24.642026 16985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:24.646530 16985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:24.646865 16985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:24.668680 16985 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:34025
I20260811 12:43:24.668707 17062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:34025 every 8 connection(s)
I20260811 12:43:24.670743 16985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:24.675935 17063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:24.678442 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 16985
I20260811 12:43:24.678745 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:43:24.679652 745 external_mini_cluster.cc:1428] Setting key a5481be6d9a3b44a6dfdc8320a27066a
I20260811 12:43:24.693823 17063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap starting.
I20260811 12:43:24.698307 17063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Neither blocks nor log segments found. Creating new log.
Aug 11 12:43:24 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:24.699734 17063 log.cc:824] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:24.704066 17063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: No bootstrap required, opened a new log
I20260811 12:43:24.711779 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:24.682081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40682 (local address 127.0.186.126:34025)
0811 12:43:24.683737 (+ 1656us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:24.683756 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:24.683812 (+ 56us) server_negotiation.cc:407] Connection header received
0811 12:43:24.686459 (+ 2647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:24.686489 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:24.687095 (+ 606us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:24.687556 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:24.689423 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:24.691990 (+ 2567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:24.693632 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:24.694889 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:24.695093 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:24.701409 (+ 6316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:24.701423 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:24.701443 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:24.701506 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:24.706496 (+ 4990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:24.707332 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:24.707341 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:24.707350 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:24.707585 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:24.708047 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:24.708051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:24.708055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:24.708699 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:24.709085 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:24.709521 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 12:43:24.710244 (+ 723us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1368,"thread_start_us":1113,"threads_started":1}
I20260811 12:43:24.718679 17063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:24.719148 17063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:24.719262 17063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16269073447244499cabb54331e8a21f, State: Initialized, Role: FOLLOWER
I20260811 12:43:24.719915 17063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:24.720194 17063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:24.720322 17063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:24.720489 17063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:24.723429 17063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:24.723913 17063 leader_election.cc:302] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16269073447244499cabb54331e8a21f; no voters:
I20260811 12:43:24.724514 17063 leader_election.cc:288] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:43:24.724684 17070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:24.725606 17070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 LEADER]: Becoming Leader. State: Replica: 16269073447244499cabb54331e8a21f, State: Running, Role: LEADER
I20260811 12:43:24.726248 17070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:24.727195 17063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:24.729756 17071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16269073447244499cabb54331e8a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } } }
I20260811 12:43:24.729779 17072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16269073447244499cabb54331e8a21f. Latest consensus state: current_term: 1 leader_uuid: "16269073447244499cabb54331e8a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } } }
I20260811 12:43:24.730202 17071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:24.730225 17072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: This master's current role is: LEADER
W20260811 12:43:24.740617 17090 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:43:24.740789 17090 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:43:24.740996 17077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:24.743304 17077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:24.753902 17077 catalog_manager.cc:1347] Generated new cluster ID: 2d39666340f743de9c7dcafa5fa82f82
I20260811 12:43:24.754031 17077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:24.777009 17077 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:43:24.779008 17077 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:24.788861 17077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Generated new TSK 0
I20260811 12:43:24.789776 17077 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:43:24.869088 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34025
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:25.233021 17095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:25.233429 17095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:25.233587 17095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:25.241503 17095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:25.241677 17095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:25.241876 17095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:43:25.252190 17095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:25.253720 17095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:25.255167 17095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:25.269325 17101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:25.269486 17104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:25.269349 17102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:25.270712 17095 server_base.cc:1034] running on GCE node
I20260811 12:43:25.271400 17095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:25.272440 17095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:25.273700 17095 hybrid_clock.cc:648] HybridClock initialized: now 1786452205273627 us; error 65 us; skew 500 ppm
I20260811 12:43:25.274163 17095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:25 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452205, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:25.277545 17095 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:43:25.279171 17095 webserver.cc:460] Webserver started at http://127.0.186.65:46419/ using document root <none> and password file <none>
I20260811 12:43:25.279955 17095 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:25.280120 17095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:25.280467 17095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:25.283653 17095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "bb2ebec2f0c5483d8800e2de4b7ec096"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "bd6329afa5d74b9eb81e29e4d7207515"
server_key_iv: "bbcbd821f8beda8b4168939ae3d3b07c"
server_key_version: "encryptionkey@0"
I20260811 12:43:25.284514 17095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "bb2ebec2f0c5483d8800e2de4b7ec096"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "bd6329afa5d74b9eb81e29e4d7207515"
server_key_iv: "bbcbd821f8beda8b4168939ae3d3b07c"
server_key_version: "encryptionkey@0"
I20260811 12:43:25.290082 17095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 12:43:25.293790 17111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:25.295279 17095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:43:25.295468 17095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "bb2ebec2f0c5483d8800e2de4b7ec096"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "bd6329afa5d74b9eb81e29e4d7207515"
server_key_iv: "bbcbd821f8beda8b4168939ae3d3b07c"
server_key_version: "encryptionkey@0"
I20260811 12:43:25.295703 17095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:25.313118 17095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:25.317519 17095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:25.317840 17095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:25.318972 17095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:25.320412 17095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:25.320492 17095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:25.320683 17095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:25.320813 17095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 12:43:25.355680 17095 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:33959
I20260811 12:43:25.355731 17238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:33959 every 8 connection(s)
I20260811 12:43:25.357209 17095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:43:25.364239 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 17095
I20260811 12:43:25.364482 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:43:25.365235 745 external_mini_cluster.cc:1428] Setting key 974903858ffd61b4923403cefd0a5f3f
Aug 11 12:43:25 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452205, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:25.379678 17244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:25.360081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:57409 (local address 127.0.186.126:34025)
0811 12:43:25.360595 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:25.360600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:25.361482 (+ 882us) server_negotiation.cc:407] Connection header received
0811 12:43:25.363376 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:25.363382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:25.363481 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:25.363606 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:25.365391 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.366159 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.367741 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.368181 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.368324 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:25.372249 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:25.372257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:25.372265 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:25.372314 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:25.376060 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:25.376917 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:25.376925 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:25.376931 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:25.377098 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:25.377540 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:25.377545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:25.377550 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:25.377948 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:25.378117 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:25.378853 (+ 736us) server_negotiation.cc:299] Negotiation successful
0811 12:43:25.379161 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":285,"threads_started":1}
I20260811 12:43:25.380707 17247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:25.360501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:57409)
0811 12:43:25.361301 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:25.361356 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:25.363087 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:25.363877 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:25.363885 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:25.364487 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:25.365214 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:25.365232 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.366351 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.366356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:25.367583 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:25.367595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.368420 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.368429 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:25.368715 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:25.369503 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:25.369526 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:25.371985 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:25.376241 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:25.376248 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:25.376262 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:25.376710 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:25.377214 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:25.377217 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:25.377220 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:25.377419 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:25.378083 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:25.378089 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:25.378449 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 12:43:25.378696 (+ 247us) client_negotiation.cc:240] Negotiation successful
0811 12:43:25.379107 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":360,"threads_started":1}
I20260811 12:43:25.382580 17239 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34025
I20260811 12:43:25.382926 17239 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:25.383715 17239 heartbeater.cc:511] Master 127.0.186.126:34025 requested a full tablet report, sending...
I20260811 12:43:25.386330 17022 ts_manager.cc:194] Registered new tserver with Master: bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65:33959)
I20260811 12:43:25.388640 17022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:57409
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:43:25.441354 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34025
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:25.814656 17252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:25.814970 17252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:25.815150 17252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:25.822983 17252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:25.823118 17252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:25.823299 17252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:43:25.834159 17252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:25.835654 17252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:25.837174 17252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:25.851445 17258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:25.851452 17260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:25.851470 17262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:25.852329 17252 server_base.cc:1034] running on GCE node
I20260811 12:43:25.853085 17252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:25.854204 17252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:25.855458 17252 hybrid_clock.cc:648] HybridClock initialized: now 1786452205855404 us; error 42 us; skew 500 ppm
I20260811 12:43:25.855831 17252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:25 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452205, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:25.859571 17252 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:43:25.861166 17252 webserver.cc:460] Webserver started at http://127.0.186.66:38893/ using document root <none> and password file <none>
I20260811 12:43:25.861881 17252 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:25.862033 17252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:25.862377 17252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:25.865736 17252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "3663e0a7a5a64315af31715b60a47ab2"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "dadb69beee3e70d1982c6930efe1a47b"
server_key_iv: "207a939b709b7be2323f809e8d66bc92"
server_key_version: "encryptionkey@0"
I20260811 12:43:25.866539 17252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "3663e0a7a5a64315af31715b60a47ab2"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "dadb69beee3e70d1982c6930efe1a47b"
server_key_iv: "207a939b709b7be2323f809e8d66bc92"
server_key_version: "encryptionkey@0"
I20260811 12:43:25.871981 17252 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:43:25.875667 17269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:25.877223 17252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 12:43:25.877441 17252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "3663e0a7a5a64315af31715b60a47ab2"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "dadb69beee3e70d1982c6930efe1a47b"
server_key_iv: "207a939b709b7be2323f809e8d66bc92"
server_key_version: "encryptionkey@0"
I20260811 12:43:25.877667 17252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:25.889619 17252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:25.894362 17252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:25.894695 17252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:25.895723 17252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:25.897199 17252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:25.897303 17252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:25.897456 17252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:25.897533 17252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:25.933087 17252 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:42115
I20260811 12:43:25.933115 17393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:42115 every 8 connection(s)
I20260811 12:43:25.934499 17252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:43:25.935745 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 17252
I20260811 12:43:25.935961 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:43:25.936571 745 external_mini_cluster.cc:1428] Setting key f0f14394c4145afbb206431ac5cb8e51
Aug 11 12:43:25 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452205, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:25.961567 17396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:25.937528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:33529 (local address 127.0.186.126:34025)
0811 12:43:25.938041 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:25.938045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:25.939290 (+ 1245us) server_negotiation.cc:407] Connection header received
0811 12:43:25.942287 (+ 2997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:25.942292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:25.942363 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:25.942491 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:25.945197 (+ 2706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.945942 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.948848 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.949345 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.949454 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:25.954527 (+ 5073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:25.954533 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:25.954537 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:25.954575 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:25.957747 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:25.958834 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:25.958839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:25.958842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:25.958990 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:25.959570 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:25.959574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:25.959577 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:25.959877 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:25.960078 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:25.960891 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 12:43:25.961167 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":302,"threads_started":1}
I20260811 12:43:25.962664 17397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:25.938170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:33529)
0811 12:43:25.939095 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:25.939158 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:25.941936 (+ 2778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:25.942757 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:25.942771 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:25.943804 (+ 1033us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:25.944780 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:25.944815 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.946136 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.946145 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:25.948595 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:25.948617 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:25.949625 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:25.949636 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:25.950024 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:25.950897 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:25.950937 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:25.954242 (+ 3305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:25.957919 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:25.957931 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:25.957952 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:25.958678 (+ 726us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:25.959123 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:25.959128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:25.959132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:25.959428 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:25.960045 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:25.960053 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:25.960461 (+ 408us) client_negotiation.cc:769] Sending connection context
0811 12:43:25.960784 (+ 323us) client_negotiation.cc:240] Negotiation successful
0811 12:43:25.961401 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":379,"threads_started":1}
I20260811 12:43:25.964650 17394 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34025
I20260811 12:43:25.965127 17394 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:25.965973 17394 heartbeater.cc:511] Master 127.0.186.126:34025 requested a full tablet report, sending...
I20260811 12:43:25.967756 17022 ts_manager.cc:194] Registered new tserver with Master: 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115)
I20260811 12:43:25.968701 17022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:33529
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:43:26.016865 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34025
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:26.381403 17403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:26.381803 17403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:26.382004 17403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:26.390407 17403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:26.390892 17403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:26.391110 17403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:43:26.392055 17239 heartbeater.cc:503] Master 127.0.186.126:34025 was elected leader, sending a full tablet report...
I20260811 12:43:26.402243 17403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:26.403709 17403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:26.405133 17403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:26.419137 17412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:26.419070 17410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:26.419339 17409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:26.419914 17403 server_base.cc:1034] running on GCE node
I20260811 12:43:26.420601 17403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:26.421626 17403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:26.422883 17403 hybrid_clock.cc:648] HybridClock initialized: now 1786452206422811 us; error 60 us; skew 500 ppm
I20260811 12:43:26.423231 17403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:26 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452206, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:26.426594 17403 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:43:26.428326 17403 webserver.cc:460] Webserver started at http://127.0.186.67:42893/ using document root <none> and password file <none>
I20260811 12:43:26.429142 17403 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:26.429322 17403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:26.429733 17403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:26.432976 17403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "ff2419db09664872bc8c49fb65b23685"
format_stamp: "Formatted at 2026-08-11 12:43:26 on dist-test-slave-qg60"
server_key: "eb0a299ba7e7a3dd395d5df29a8794b8"
server_key_iv: "97f36fcc370f1476c52ba239de196aa3"
server_key_version: "encryptionkey@0"
I20260811 12:43:26.433843 17403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "ff2419db09664872bc8c49fb65b23685"
format_stamp: "Formatted at 2026-08-11 12:43:26 on dist-test-slave-qg60"
server_key: "eb0a299ba7e7a3dd395d5df29a8794b8"
server_key_iv: "97f36fcc370f1476c52ba239de196aa3"
server_key_version: "encryptionkey@0"
I20260811 12:43:26.439263 17403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:43:26.443377 17419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:26.445288 17403 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:43:26.445472 17403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "ff2419db09664872bc8c49fb65b23685"
format_stamp: "Formatted at 2026-08-11 12:43:26 on dist-test-slave-qg60"
server_key: "eb0a299ba7e7a3dd395d5df29a8794b8"
server_key_iv: "97f36fcc370f1476c52ba239de196aa3"
server_key_version: "encryptionkey@0"
I20260811 12:43:26.445811 17403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:26.461669 17403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:26.466822 17403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:26.467150 17403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:26.468375 17403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:26.470185 17403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:26.470309 17403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:26.470476 17403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:26.470557 17403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:26.506876 17403 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:33053
I20260811 12:43:26.506922 17551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:33053 every 8 connection(s)
I20260811 12:43:26.508246 17403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:43:26.511478 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 17403
I20260811 12:43:26.511737 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:43:26.512218 745 external_mini_cluster.cc:1428] Setting key c12003b18dcd89f7137777d8b0adbe92
Aug 11 12:43:26 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452206, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:26.529773 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.511226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:47745 (local address 127.0.186.126:34025)
0811 12:43:26.511816 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.511823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.512797 (+ 974us) server_negotiation.cc:407] Connection header received
0811 12:43:26.514781 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.514787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.514873 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.515007 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:26.516569 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.517493 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.519077 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.519508 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.519650 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.523367 (+ 3717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:26.523374 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:26.523380 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:26.523428 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:26.526295 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.527107 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.527114 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.527118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.527308 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.527796 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.527801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.527804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.528129 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:26.528255 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.529222 (+ 967us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.529405 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":286,"threads_started":1}
I20260811 12:43:26.530932 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.511685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:47745)
0811 12:43:26.512585 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.512643 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:26.514488 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:26.515255 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:26.515264 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:26.515813 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:26.516391 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.516410 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.517668 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.517672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.518916 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.518929 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.519752 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.519763 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.520032 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.520846 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:26.520870 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:26.523135 (+ 2265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:26.526481 (+ 3346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:26.526491 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:26.526509 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:26.526977 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:26.527428 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:26.527434 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:26.527438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:26.527661 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:26.528260 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:26.528266 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:26.528689 (+ 423us) client_negotiation.cc:769] Sending connection context
0811 12:43:26.529099 (+ 410us) client_negotiation.cc:240] Negotiation successful
0811 12:43:26.529587 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":390,"threads_started":1}
I20260811 12:43:26.532370 17552 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34025
I20260811 12:43:26.532716 17552 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:26.533609 17552 heartbeater.cc:511] Master 127.0.186.126:34025 requested a full tablet report, sending...
I20260811 12:43:26.535204 17022 ts_manager.cc:194] Registered new tserver with Master: ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
I20260811 12:43:26.536031 17022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:47745
I20260811 12:43:26.540195 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:43:26.559121 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.545247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40698 (local address 127.0.186.126:34025)
0811 12:43:26.545421 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.545425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.545973 (+ 548us) server_negotiation.cc:407] Connection header received
0811 12:43:26.546141 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.546145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.546212 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.546300 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:26.547836 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.548570 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.550192 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.550679 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.550775 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.553310 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:26.553314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:26.553318 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:26.553357 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:26.555879 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.556589 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.556592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.556594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.556723 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.557467 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.557471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.557473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.557795 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:26.557986 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.558473 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.558743 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:43:26.563714 17022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:43:26.570910 17022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:43:26.595600 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.584705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57478 (local address 127.0.186.67:33053)
0811 12:43:26.585703 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.585716 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.586570 (+ 854us) server_negotiation.cc:407] Connection header received
0811 12:43:26.586694 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.586702 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.586984 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.587196 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:26.588394 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.590142 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.593169 (+ 3027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.594299 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.594461 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.594735 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.595043 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.595215 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":557,"threads_started":1}
I20260811 12:43:26.595683 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.584513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33053 (local address 127.0.0.1:57478)
0811 12:43:26.586104 (+ 1591us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.586154 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:26.586349 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:26.587530 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:26.587542 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:26.587592 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:26.588138 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.588155 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.590374 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.590382 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.592987 (+ 2605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.593003 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.594547 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.594554 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.594771 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.594825 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 12:43:26.594973 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 12:43:26.595200 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1332,"mutex_wait_us":48,"thread_start_us":1175,"threads_started":1}
I20260811 12:43:26.597250 17568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.585086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40936)
0811 12:43:26.586354 (+ 1268us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.586379 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:26.586545 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:26.587813 (+ 1268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:26.587817 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:26.587846 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:26.588412 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.588428 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.590951 (+ 2523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.590959 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.593394 (+ 2435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.593410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.596371 (+ 2961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.596381 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.596579 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.596611 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 12:43:26.596710 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 12:43:26.596877 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"mutex_wait_us":76,"thread_start_us":1213,"threads_started":1}
I20260811 12:43:26.597383 17570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.585239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40936 (local address 127.0.186.65:33959)
0811 12:43:26.587213 (+ 1974us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.587223 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.587251 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:43:26.587349 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.587356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.587591 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.588625 (+ 1034us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:26.588962 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.590783 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.593585 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.595116 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.595262 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.595525 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.596815 (+ 1290us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.597010 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1784,"thread_start_us":1609,"threads_started":1}
I20260811 12:43:26.598618 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.586717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42115 (local address 127.0.0.1:46118)
0811 12:43:26.589278 (+ 2561us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.589293 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:26.589439 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:26.589983 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:26.589987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:26.590013 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:26.590479 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.590497 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.592492 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.592498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.594666 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.594683 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.597781 (+ 3098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.597790 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.597984 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.598022 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 12:43:26.598137 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 12:43:26.598275 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2451,"thread_start_us":2321,"threads_started":1}
I20260811 12:43:26.598934 17572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.587283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.0.186.66:42115)
0811 12:43:26.588810 (+ 1527us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.588823 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.589407 (+ 584us) server_negotiation.cc:407] Connection header received
0811 12:43:26.589631 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.589639 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.589805 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.589993 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:26.590696 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.592339 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.594878 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.597233 (+ 2355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.597395 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.597599 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.598214 (+ 615us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.598427 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1322,"thread_start_us":1200,"threads_started":1}
I20260811 12:43:26.600487 17473 tablet_service.cc:1467] Processing CreateTablet for tablet 3111cce55b054a71bafcf5868d547806 (DEFAULT_TABLE table=test-table [id=a7baf016d0994fa8aa1d9a07eab95ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:26.601274 17166 tablet_service.cc:1467] Processing CreateTablet for tablet 3111cce55b054a71bafcf5868d547806 (DEFAULT_TABLE table=test-table [id=a7baf016d0994fa8aa1d9a07eab95ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:26.602599 17166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3111cce55b054a71bafcf5868d547806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:26.602622 17473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3111cce55b054a71bafcf5868d547806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:26.602480 17318 tablet_service.cc:1467] Processing CreateTablet for tablet 3111cce55b054a71bafcf5868d547806 (DEFAULT_TABLE table=test-table [id=a7baf016d0994fa8aa1d9a07eab95ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:26.603880 17318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3111cce55b054a71bafcf5868d547806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:26.615727 17573 tablet_bootstrap.cc:492] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Bootstrap starting.
I20260811 12:43:26.619252 17574 tablet_bootstrap.cc:492] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Bootstrap starting.
I20260811 12:43:26.619896 17573 tablet_bootstrap.cc:654] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:26.621493 17573 log.cc:824] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:26.621546 17575 tablet_bootstrap.cc:492] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Bootstrap starting.
I20260811 12:43:26.623497 17574 tablet_bootstrap.cc:654] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:26.624848 17575 tablet_bootstrap.cc:654] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:26.625176 17574 log.cc:824] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:26.625950 17575 log.cc:824] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:26.628919 17574 tablet_bootstrap.cc:492] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: No bootstrap required, opened a new log
I20260811 12:43:26.629215 17574 ts_tablet_manager.cc:1397] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260811 12:43:26.629652 17573 tablet_bootstrap.cc:492] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: No bootstrap required, opened a new log
I20260811 12:43:26.630019 17573 ts_tablet_manager.cc:1397] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.002s
I20260811 12:43:26.630219 17575 tablet_bootstrap.cc:492] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: No bootstrap required, opened a new log
I20260811 12:43:26.630524 17575 ts_tablet_manager.cc:1397] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260811 12:43:26.637795 17574 raft_consensus.cc:348] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.638253 17574 raft_consensus.cc:374] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:26.638361 17574 raft_consensus.cc:729] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3663e0a7a5a64315af31715b60a47ab2, State: Initialized, Role: FOLLOWER
I20260811 12:43:26.638983 17574 consensus_queue.cc:260] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.640210 17394 heartbeater.cc:503] Master 127.0.186.126:34025 was elected leader, sending a full tablet report...
I20260811 12:43:26.641036 17574 ts_tablet_manager.cc:1428] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Time spent starting tablet: real 0.012s user 0.006s sys 0.006s
I20260811 12:43:26.641363 17573 raft_consensus.cc:348] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.641909 17573 raft_consensus.cc:374] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:26.641688 17575 raft_consensus.cc:348] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.642010 17573 raft_consensus.cc:729] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb2ebec2f0c5483d8800e2de4b7ec096, State: Initialized, Role: FOLLOWER
I20260811 12:43:26.642141 17575 raft_consensus.cc:374] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:26.642234 17575 raft_consensus.cc:729] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2419db09664872bc8c49fb65b23685, State: Initialized, Role: FOLLOWER
I20260811 12:43:26.642771 17573 consensus_queue.cc:260] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.642925 17575 consensus_queue.cc:260] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.645069 17573 ts_tablet_manager.cc:1428] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260811 12:43:26.651007 17575 ts_tablet_manager.cc:1428] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Time spent starting tablet: real 0.020s user 0.017s sys 0.003s
I20260811 12:43:26.651520 17552 heartbeater.cc:503] Master 127.0.186.126:34025 was elected leader, sending a full tablet report...
I20260811 12:43:26.652112 17580 raft_consensus.cc:482] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:26.652473 17580 raft_consensus.cc:504] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.662108 17580 leader_election.cc:288] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053), 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115)
I20260811 12:43:26.662974 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.656325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:44975 (local address 127.0.186.67:33053)
0811 12:43:26.656580 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.656586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.657231 (+ 645us) server_negotiation.cc:407] Connection header received
0811 12:43:26.657489 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.657494 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.657566 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.657664 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:26.658258 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.659116 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.661093 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.661867 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.662067 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.662144 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.662579 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.662710 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 12:43:26.663093 17583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.655662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33053 (local address 127.0.186.65:44975)
0811 12:43:26.657123 (+ 1461us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.657139 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:26.657313 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:26.657687 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:26.657691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:26.657722 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:26.658115 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.658125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.659252 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.659258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.660934 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.660948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.662195 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.662201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.662395 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.662431 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 12:43:26.662554 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 12:43:26.662693 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1340,"thread_start_us":1123,"threads_started":1}
I20260811 12:43:26.664367 17496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3111cce55b054a71bafcf5868d547806" candidate_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2419db09664872bc8c49fb65b23685" is_pre_election: true
I20260811 12:43:26.665153 17496 raft_consensus.cc:2454] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb2ebec2f0c5483d8800e2de4b7ec096 in term 0.
I20260811 12:43:26.666486 17115 leader_election.cc:302] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096, ff2419db09664872bc8c49fb65b23685; no voters:
I20260811 12:43:26.667241 17580 raft_consensus.cc:2781] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:43:26.667484 17580 raft_consensus.cc:482] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:43:26.667635 17580 raft_consensus.cc:3037] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:26.669976 17572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.656659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:39621 (local address 127.0.186.66:42115)
0811 12:43:26.656890 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.656896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.663604 (+ 6708us) server_negotiation.cc:407] Connection header received
0811 12:43:26.663905 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.663913 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.664020 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.664093 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:26.664751 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.665839 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.668077 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.669016 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.669192 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.669276 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.669573 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.669711 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 12:43:26.670001 17583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.656043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42115 (local address 127.0.186.65:39621)
0811 12:43:26.663488 (+ 7445us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.663508 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:26.663720 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:26.664311 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:26.664315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:26.664343 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:26.664532 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.664547 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.666059 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.666064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.667902 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:26.667916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.669192 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.669199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:26.669401 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.669425 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 12:43:26.669542 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 12:43:26.669697 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7329,"threads_started":1}
I20260811 12:43:26.671844 17580 raft_consensus.cc:504] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.672576 17580 leader_election.cc:288] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 1 election: Requested vote from peers ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053), 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115)
I20260811 12:43:26.673247 17496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3111cce55b054a71bafcf5868d547806" candidate_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2419db09664872bc8c49fb65b23685"
I20260811 12:43:26.673497 17496 raft_consensus.cc:3037] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:26.674471 17341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3111cce55b054a71bafcf5868d547806" candidate_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3663e0a7a5a64315af31715b60a47ab2" is_pre_election: true
I20260811 12:43:26.675030 17341 raft_consensus.cc:2454] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb2ebec2f0c5483d8800e2de4b7ec096 in term 0.
I20260811 12:43:26.675678 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3111cce55b054a71bafcf5868d547806" candidate_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3663e0a7a5a64315af31715b60a47ab2"
I20260811 12:43:26.675949 17340 raft_consensus.cc:3037] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:26.676420 17496 raft_consensus.cc:2454] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb2ebec2f0c5483d8800e2de4b7ec096 in term 1.
I20260811 12:43:26.676946 17115 leader_election.cc:302] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096, ff2419db09664872bc8c49fb65b23685; no voters:
I20260811 12:43:26.677311 17582 raft_consensus.cc:2781] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:26.677536 17582 raft_consensus.cc:686] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 LEADER]: Becoming Leader. State: Replica: bb2ebec2f0c5483d8800e2de4b7ec096, State: Running, Role: LEADER
I20260811 12:43:26.678082 17582 consensus_queue.cc:237] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } }
I20260811 12:43:26.679337 17340 raft_consensus.cc:2454] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb2ebec2f0c5483d8800e2de4b7ec096 in term 1.
I20260811 12:43:26.682818 17021 catalog_manager.cc:5495] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65). New cstate: current_term: 1 leader_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } health_report { overall_health: UNKNOWN } } }
W20260811 12:43:26.686622 17395 tablet.cc:2369] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:26.701016 17570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.694825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40952 (local address 127.0.186.65:33959)
0811 12:43:26.695040 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.695047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.695122 (+ 75us) server_negotiation.cc:407] Connection header received
0811 12:43:26.695396 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.695406 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.695500 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.695672 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:43:26.696085 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.696905 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.698423 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.698997 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.699146 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.699695 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:43:26.700336 (+ 641us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:43:26.700501 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.700600 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.700690 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:43:26.710124 17340 raft_consensus.cc:1261] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Refusing update from remote peer bb2ebec2f0c5483d8800e2de4b7ec096: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:26.710111 17496 raft_consensus.cc:1261] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Refusing update from remote peer bb2ebec2f0c5483d8800e2de4b7ec096: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:26.711138 17580 consensus_queue.cc:1035] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:26.711493 17582 consensus_queue.cc:1035] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:26.723906 17588 mvcc.cc:205] Tried to move back new op lower bound from 7317308238673018880 to 7317308238557945856. Current Snapshot: MvccSnapshot[applied={T|T < 7317308238673018880}]
I20260811 12:43:26.741243 17022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:26.741580 17022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:26.747478 17022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Sending DeleteTablet for 3 replicas of tablet 3111cce55b054a71bafcf5868d547806
I20260811 12:43:26.749056 17473 tablet_service.cc:1514] Processing DeleteTablet for tablet 3111cce55b054a71bafcf5868d547806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:26 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57478
I20260811 12:43:26.749208 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 17095
I20260811 12:43:26.750744 17599 tablet_replica.cc:330] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: stopping tablet replica
I20260811 12:43:26.750900 17318 tablet_service.cc:1514] Processing DeleteTablet for tablet 3111cce55b054a71bafcf5868d547806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:26 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:46118
I20260811 12:43:26.751281 17599 raft_consensus.cc:2229] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:26.751855 17166 tablet_service.cc:1514] Processing DeleteTablet for tablet 3111cce55b054a71bafcf5868d547806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:26 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:40936
I20260811 12:43:26.751955 17599 raft_consensus.cc:2258] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:26.754733 17599 ts_tablet_manager.cc:1905] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:26.758231 17602 tablet_replica.cc:330] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: stopping tablet replica
I20260811 12:43:26.758818 17602 raft_consensus.cc:2229] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:43:26.759649 17602 raft_consensus.cc:2258] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:26.762902 17599 ts_tablet_manager.cc:1918] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:26.763090 17599 log.cc:1196] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/3111cce55b054a71bafcf5868d547806
I20260811 12:43:26.763720 17599 ts_tablet_manager.cc:1939] T 3111cce55b054a71bafcf5868d547806 P ff2419db09664872bc8c49fb65b23685: Deleting consensus metadata
I20260811 12:43:26.765815 17004 catalog_manager.cc:4841] TS ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): tablet 3111cce55b054a71bafcf5868d547806 (table test-table [id=a7baf016d0994fa8aa1d9a07eab95ad3]) successfully deleted
I20260811 12:43:26.766309 17601 tablet_replica.cc:330] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: stopping tablet replica
I20260811 12:43:26.766777 17601 raft_consensus.cc:2229] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:26.767354 17601 raft_consensus.cc:2258] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:26.769793 17601 ts_tablet_manager.cc:1905] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 12:43:26 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:43:26.774652 17602 ts_tablet_manager.cc:1905] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:26.777341 17601 ts_tablet_manager.cc:1918] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:26.777540 17601 log.cc:1196] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/3111cce55b054a71bafcf5868d547806
I20260811 12:43:26.778151 17601 ts_tablet_manager.cc:1939] T 3111cce55b054a71bafcf5868d547806 P 3663e0a7a5a64315af31715b60a47ab2: Deleting consensus metadata
I20260811 12:43:26.778858 17570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.751555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40954 (local address 127.0.186.65:33959)
0811 12:43:26.752451 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.752457 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.757454 (+ 4997us) server_negotiation.cc:407] Connection header received
0811 12:43:26.757702 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.757712 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.757811 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.757945 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:26.761796 (+ 3851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.762956 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.765589 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.766345 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.766425 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.771448 (+ 5023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:26.771465 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:26.771484 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:26.771542 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:26.775223 (+ 3681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.776076 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.776083 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.776085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.776271 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.776767 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.776775 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.776779 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.777180 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:26.777507 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.778022 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.778375 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760}
I20260811 12:43:26.779614 17234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:26.781199 17003 catalog_manager.cc:4841] TS 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): tablet 3111cce55b054a71bafcf5868d547806 (table test-table [id=a7baf016d0994fa8aa1d9a07eab95ad3]) successfully deleted
I20260811 12:43:26.886324 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 17095
W20260811 12:43:26.910630 17003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.186.65:33959 (error 108)
I20260811 12:43:26.910876 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 17252
I20260811 12:43:26.913087 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.912348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40964)
0811 12:43:26.912642 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.912811 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260811 12:43:26.913384 17003 catalog_manager.cc:4584] TS bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65:33959): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3111cce55b054a71bafcf5868d547806: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Aug 11 12:43:26 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:43:26.926927 17572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.911751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46120 (local address 127.0.186.66:42115)
0811 12:43:26.911918 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:26.911922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:26.911974 (+ 52us) server_negotiation.cc:407] Connection header received
0811 12:43:26.912249 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:26.912256 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:26.912349 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:26.912467 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:26.914213 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.914969 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.916283 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:26.916681 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:26.916861 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:26.921247 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:26.921265 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:26.921281 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:26.921322 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:26.924236 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.925012 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.925019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.925022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.925184 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:26.925513 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:26.925516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:26.925518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:26.925933 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:26.926197 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:26.926460 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 12:43:26.926648 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 12:43:26.927742 17389 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:26.967327 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.966801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40968)
0811 12:43:26.967057 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.967164 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 12:43:26.968508 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:26.968134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40972)
0811 12:43:26.968290 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:26.968367 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 12:43:27.023200 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 17252
I20260811 12:43:27.029275 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:27.028650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40976)
0811 12:43:27.028952 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:27.029098 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 12:43:27.030457 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:27.030114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40982)
0811 12:43:27.030256 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:27.030328 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 12:43:27.047439 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 17403
Aug 11 12:43:27 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:43:27.064218 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:27.048256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.0.186.67:33053)
0811 12:43:27.048457 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:27.048465 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:27.048489 (+ 24us) server_negotiation.cc:407] Connection header received
0811 12:43:27.048724 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:27.048762 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:27.048846 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:27.048971 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:27.050499 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:27.051288 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:27.052582 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:27.053132 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:27.053272 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:27.057965 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:27.057983 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:27.057999 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:27.058041 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:27.061145 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:27.062003 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:27.062011 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:27.062013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:27.062161 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:27.062575 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:27.062586 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:27.062588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:27.062947 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:27.063243 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:27.063642 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 12:43:27.063883 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:43:27.064975 17547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:27.111482 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:27.110968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40992)
0811 12:43:27.111213 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:27.111315 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 12:43:27.112634 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:27.112208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:40994)
0811 12:43:27.112439 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:27.112515 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260811 12:43:27.157027 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 17403
I20260811 12:43:27.180294 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 16985
I20260811 12:43:27.181712 17056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:27.301205 17571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:27.300465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41008)
0811 12:43:27.300781 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:27.300906 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 12:43:27.301462 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 16985
I20260811 12:43:27.329523 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34025
--webserver_interface=127.0.186.126
--webserver_port=35019
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:34025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:27.697769 17609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:27.698202 17609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:27.698413 17609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:27.706475 17609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:27.706604 17609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:27.706686 17609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:27.706777 17609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:27.706842 17609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:27.717269 17609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:34025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=35019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:27.718699 17609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:27.720115 17609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:27.748284 17618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:27.748322 17619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:27.748284 17621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:27.754369 17609 server_base.cc:1034] running on GCE node
I20260811 12:43:27.755448 17609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:27.757462 17609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:27.758726 17609 hybrid_clock.cc:648] HybridClock initialized: now 1786452207758638 us; error 68 us; skew 500 ppm
I20260811 12:43:27.759199 17609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:27 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452207, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:27.763463 17609 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:27.765498 17609 webserver.cc:460] Webserver started at http://127.0.186.126:35019/ using document root <none> and password file <none>
I20260811 12:43:27.766399 17609 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:27.766592 17609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:27.773561 17609 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 12:43:27.776939 17628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:27.778486 17609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:43:27.778702 17609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "16269073447244499cabb54331e8a21f"
format_stamp: "Formatted at 2026-08-11 12:43:24 on dist-test-slave-qg60"
server_key: "8f6231ccf3899e6047d7e218200d2c40"
server_key_iv: "0aecc91d3001e2d1a16526535369f0b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:27.779881 17609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:27.794564 17609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:27.799216 17609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:27.799654 17609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:27.820554 17609 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:34025
I20260811 12:43:27.820597 17687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:34025 every 8 connection(s)
I20260811 12:43:27.822304 17609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:27.823383 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 17609
I20260811 12:43:27.824323 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:33959
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:34025
--webserver_port=46419
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:27.830540 17688 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:43:27.834272 17688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap starting.
I20260811 12:43:27.862776 17688 log.cc:824] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:27.879318 17688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:43:27.880021 17688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap complete.
I20260811 12:43:27.894502 17688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:27.895833 17688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16269073447244499cabb54331e8a21f, State: Initialized, Role: FOLLOWER
I20260811 12:43:27.896636 17688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:27.896978 17688 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:27.897138 17688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:27.897370 17688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 1 FOLLOWER]: Advancing to term 2
I20260811 12:43:27.903661 17688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:27.904453 17688 leader_election.cc:302] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16269073447244499cabb54331e8a21f; no voters:
I20260811 12:43:27.905347 17688 leader_election.cc:288] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 12:43:27.905499 17692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 12:43:27.907146 17692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 LEADER]: Becoming Leader. State: Replica: 16269073447244499cabb54331e8a21f, State: Running, Role: LEADER
I20260811 12:43:27.907774 17692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:27.908175 17688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:27.910720 17693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "16269073447244499cabb54331e8a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } } }
I20260811 12:43:27.910720 17694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16269073447244499cabb54331e8a21f. Latest consensus state: current_term: 2 leader_uuid: "16269073447244499cabb54331e8a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } } }
I20260811 12:43:27.911213 17693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:27.911331 17694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:27.918081 17697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:27.927217 17697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:27.928931 17697 catalog_manager.cc:1259] Loaded cluster ID: 2d39666340f743de9c7dcafa5fa82f82
I20260811 12:43:27.929129 17697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:27.932811 17697 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 12:43:27.951500 17697 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 12:43:27.953279 17712 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 12:43:27.962237 17697 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:27.964104 17697 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Loaded TSK: 0
I20260811 12:43:27.965791 17697 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 12:43:28.236343 17690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:28.236649 17690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:28.236843 17690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:28.244669 17690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:28.244871 17690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:28.245088 17690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:43:28.256345 17690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:33959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=46419
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:28.257941 17690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:28.259469 17690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:28.274240 17723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:28.274211 17721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:28.275578 17690 server_base.cc:1034] running on GCE node
W20260811 12:43:28.277333 17719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:28.278189 17690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:28.279349 17690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:28.280614 17690 hybrid_clock.cc:648] HybridClock initialized: now 1786452208280546 us; error 41 us; skew 500 ppm
I20260811 12:43:28.281008 17690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:28 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452208, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:28.284554 17690 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:43:28.286446 17690 webserver.cc:460] Webserver started at http://127.0.186.65:46419/ using document root <none> and password file <none>
I20260811 12:43:28.287222 17690 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:28.287384 17690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:28.293450 17690 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 12:43:28.296835 17731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:28.298353 17690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:43:28.298552 17690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "bb2ebec2f0c5483d8800e2de4b7ec096"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "bd6329afa5d74b9eb81e29e4d7207515"
server_key_iv: "bbcbd821f8beda8b4168939ae3d3b07c"
server_key_version: "encryptionkey@0"
I20260811 12:43:28.299654 17690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:28.319000 17690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:28.323812 17690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:28.324136 17690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:28.325342 17690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:28.327322 17739 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260811 12:43:28.333362 17739 ts_tablet_manager.cc:1852] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260811 12:43:28.334421 17739 ts_tablet_manager.cc:1905] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:28.342717 17739 ts_tablet_manager.cc:1918] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:28.342957 17739 log.cc:1196] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/3111cce55b054a71bafcf5868d547806
I20260811 12:43:28.343500 17739 ts_tablet_manager.cc:1939] T 3111cce55b054a71bafcf5868d547806 P bb2ebec2f0c5483d8800e2de4b7ec096: Deleting consensus metadata
I20260811 12:43:28.343940 17690 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260811 12:43:28.344218 17690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260811 12:43:28.344385 17690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:28.344491 17690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:28.381498 17690 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:33959
I20260811 12:43:28.381551 17862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:33959 every 8 connection(s)
I20260811 12:43:28.382952 17690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:43:28.386783 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 17690
I20260811 12:43:28.387672 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:42115
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:34025
--webserver_port=38893
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:43:28 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452208, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:28.413518 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:28.386340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:40931 (local address 127.0.186.126:34025)
0811 12:43:28.387117 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:28.387135 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:28.387761 (+ 626us) server_negotiation.cc:407] Connection header received
0811 12:43:28.391304 (+ 3543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:28.391317 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:28.391672 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:28.391968 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:28.394239 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.395513 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.398223 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.398908 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.399065 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:28.403797 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:28.403817 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:28.403841 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:28.403905 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:28.408367 (+ 4462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:28.409386 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:28.409399 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:28.409409 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:28.409647 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:28.410332 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:28.410336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:28.410338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:28.410862 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:28.411037 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:28.412090 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0811 12:43:28.412452 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":300,"threads_started":1}
I20260811 12:43:28.413949 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:28.386418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:40931)
0811 12:43:28.387531 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:28.387589 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:28.390654 (+ 3065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:28.392191 (+ 1537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:28.392204 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:28.393090 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:28.393957 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:28.393987 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.395723 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.395732 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:28.398039 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:28.398060 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.399185 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.399195 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:28.399508 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:28.400368 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:28.400408 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:28.403447 (+ 3039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:28.408537 (+ 5090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:28.408545 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:28.408557 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:28.409211 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:28.409888 (+ 677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:28.409896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:28.409902 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:28.410187 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:28.411046 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:28.411057 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:28.411573 (+ 516us) client_negotiation.cc:769] Sending connection context
0811 12:43:28.411894 (+ 321us) client_negotiation.cc:240] Negotiation successful
0811 12:43:28.412506 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":804,"thread_start_us":595,"threads_started":1}
I20260811 12:43:28.416844 17863 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34025
I20260811 12:43:28.417244 17863 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:28.417979 17863 heartbeater.cc:511] Master 127.0.186.126:34025 requested a full tablet report, sending...
I20260811 12:43:28.420356 17646 ts_manager.cc:194] Registered new tserver with Master: bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65:33959)
I20260811 12:43:28.421911 17646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:40931
W20260811 12:43:28.758777 17867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:28.759186 17867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:28.759363 17867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:28.767197 17867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:28.767311 17867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:28.767483 17867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:43:28.778291 17867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:42115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=38893
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:28.779755 17867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:28.781351 17867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:28.795374 17873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:28.795431 17876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:28.795469 17878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:28.796607 17867 server_base.cc:1034] running on GCE node
I20260811 12:43:28.797354 17867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:28.798440 17867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:28.799691 17867 hybrid_clock.cc:648] HybridClock initialized: now 1786452208799628 us; error 50 us; skew 500 ppm
I20260811 12:43:28.800091 17867 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:28 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452208, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:28.803682 17867 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:43:28.805573 17867 webserver.cc:460] Webserver started at http://127.0.186.66:38893/ using document root <none> and password file <none>
I20260811 12:43:28.806313 17867 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:28.806464 17867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:28.812440 17867 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 12:43:28.815428 17888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:28.816962 17867 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:43:28.817150 17867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "3663e0a7a5a64315af31715b60a47ab2"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "dadb69beee3e70d1982c6930efe1a47b"
server_key_iv: "207a939b709b7be2323f809e8d66bc92"
server_key_version: "encryptionkey@0"
I20260811 12:43:28.818197 17867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:28.844225 17867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:28.848694 17867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:28.849071 17867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:28.850117 17867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:28.851487 17867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:28.851605 17867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:28.851747 17867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:28.851832 17867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:28.887789 17867 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:42115
I20260811 12:43:28.887883 18015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:42115 every 8 connection(s)
I20260811 12:43:28.889464 17867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:43:28.897001 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 17867
I20260811 12:43:28.897848 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:33053
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:34025
--webserver_port=42893
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:43:28 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452208, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:28.913582 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:28.892225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:33289 (local address 127.0.186.126:34025)
0811 12:43:28.892423 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:28.892427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:28.893572 (+ 1145us) server_negotiation.cc:407] Connection header received
0811 12:43:28.895485 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:28.895492 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:28.895605 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:28.895730 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:28.897743 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.898676 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.901294 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.901723 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.901828 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:28.906314 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:28.906319 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:28.906322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:28.906359 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:28.909692 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:28.910569 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:28.910574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:28.910577 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:28.910717 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:28.911240 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:28.911245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:28.911247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:28.911686 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:28.911876 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:28.912685 (+ 809us) server_negotiation.cc:299] Negotiation successful
0811 12:43:28.913067 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:43:28.914207 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:28.892634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:33289)
0811 12:43:28.893391 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:28.893436 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:28.895198 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:28.895982 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:28.895991 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:28.896641 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:28.897519 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:28.897546 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.898872 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.898881 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:28.901091 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:28.901109 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:28.901969 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:28.901978 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:28.902341 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:28.903128 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:28.903174 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:28.906054 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:28.909868 (+ 3814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:28.909878 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:28.909897 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:28.910392 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:28.910850 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:28.910855 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:28.910859 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:28.911087 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:28.911852 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:28.911859 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:28.912235 (+ 376us) client_negotiation.cc:769] Sending connection context
0811 12:43:28.912488 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 12:43:28.913006 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":277,"threads_started":1}
I20260811 12:43:28.915901 18016 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34025
I20260811 12:43:28.916249 18016 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:28.917176 18016 heartbeater.cc:511] Master 127.0.186.126:34025 requested a full tablet report, sending...
I20260811 12:43:28.918802 17646 ts_manager.cc:194] Registered new tserver with Master: 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115)
I20260811 12:43:28.919770 17646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:33289
W20260811 12:43:29.261452 18020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:29.261797 18020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:29.262003 18020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:29.269501 18020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:29.269680 18020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:29.269881 18020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:43:29.279973 18020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:33053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=42893
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:29.281522 18020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:29.282948 18020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:29.297096 18029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:29.297046 18026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:29.297153 18027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:29.298027 18020 server_base.cc:1034] running on GCE node
I20260811 12:43:29.298712 18020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:29.299784 18020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:29.301036 18020 hybrid_clock.cc:648] HybridClock initialized: now 1786452209300959 us; error 64 us; skew 500 ppm
I20260811 12:43:29.301409 18020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:29 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:29.305385 18020 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:43:29.307070 18020 webserver.cc:460] Webserver started at http://127.0.186.67:42893/ using document root <none> and password file <none>
I20260811 12:43:29.307833 18020 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:29.308053 18020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:29.314080 18020 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:43:29.317077 18037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:29.318531 18020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:43:29.318750 18020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "ff2419db09664872bc8c49fb65b23685"
format_stamp: "Formatted at 2026-08-11 12:43:26 on dist-test-slave-qg60"
server_key: "eb0a299ba7e7a3dd395d5df29a8794b8"
server_key_iv: "97f36fcc370f1476c52ba239de196aa3"
server_key_version: "encryptionkey@0"
I20260811 12:43:29.319897 18020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:29.333544 18020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:29.337852 18020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:29.338155 18020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:29.339184 18020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:29.340658 18020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:29.340816 18020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 12:43:29.340947 18020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:29.341038 18020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:29.377974 18020 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:33053
I20260811 12:43:29.378067 18165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:33053 every 8 connection(s)
I20260811 12:43:29.379529 18020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:43:29.384824 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18020
Aug 11 12:43:29 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:29.405377 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.382355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:36083 (local address 127.0.186.126:34025)
0811 12:43:29.382601 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.382608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.383984 (+ 1376us) server_negotiation.cc:407] Connection header received
0811 12:43:29.386741 (+ 2757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.386748 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.386838 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.386920 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:29.388957 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.390274 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.392888 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.393620 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.393793 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.398213 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:29.398219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:29.398222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:29.398256 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:29.401780 (+ 3524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:29.402638 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:29.402643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:29.402645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:29.402768 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:29.403352 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:29.403356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:29.403359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:29.403651 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:29.403833 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.404723 (+ 890us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.404981 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:43:29.405723 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.385846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40708 (local address 127.0.186.126:34025)
0811 12:43:29.390190 (+ 4344us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.390200 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.390219 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:43:29.390272 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.390277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.390358 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.390469 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:29.392671 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.393944 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.396106 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.396568 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.396728 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.399667 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:29.399672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:29.399675 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:29.399721 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:29.402577 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:29.403457 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:29.403465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:29.403471 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:29.403606 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:29.404048 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:29.404056 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:29.404060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:29.404369 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:29.404653 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.405035 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.405295 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4224,"thread_start_us":3965,"threads_started":1}
I20260811 12:43:29.406967 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.382841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:36083)
0811 12:43:29.383785 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:29.383833 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:29.386346 (+ 2513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:29.387446 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:29.387456 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:29.388119 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:29.388687 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.388704 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.390480 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.390485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.392667 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.392685 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.393915 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.393920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.394274 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.395094 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:29.395127 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:29.397954 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:29.401950 (+ 3996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:29.401961 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:29.401980 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:29.402473 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:29.402979 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:29.402984 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:29.402988 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:29.403205 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:29.403790 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:29.403807 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:29.404308 (+ 501us) client_negotiation.cc:769] Sending connection context
0811 12:43:29.404603 (+ 295us) client_negotiation.cc:240] Negotiation successful
0811 12:43:29.405216 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":365,"threads_started":1}
I20260811 12:43:29.408411 18166 heartbeater.cc:347] Connected to a master server at 127.0.186.126:34025
I20260811 12:43:29.408802 18166 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:29.409672 18166 heartbeater.cc:511] Master 127.0.186.126:34025 requested a full tablet report, sending...
I20260811 12:43:29.411126 17646 ts_manager.cc:194] Registered new tserver with Master: ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
I20260811 12:43:29.411931 17646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:36083
I20260811 12:43:29.421572 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:43:29.425117 17863 heartbeater.cc:503] Master 127.0.186.126:34025 was elected leader, sending a full tablet report...
I20260811 12:43:29.429414 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.422581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40714 (local address 127.0.186.126:34025)
0811 12:43:29.422741 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.422746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.423415 (+ 669us) server_negotiation.cc:407] Connection header received
0811 12:43:29.423581 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.423584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.423799 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.423977 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:43:29.424456 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.425487 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.427118 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.427568 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.427705 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.428250 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:43:29.428799 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:43:29.428978 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.429043 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.429145 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 12:43:29.430356 17646 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40714:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:43:29.437866 17646 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:43:29.463479 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.450448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.0.186.66:42115)
0811 12:43:29.452315 (+ 1867us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.452326 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.452359 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:43:29.452465 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.452473 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.452750 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.452948 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:29.454234 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.456331 (+ 2097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.460203 (+ 3872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.461781 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.461948 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.462177 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.462955 (+ 778us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.463154 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1670,"thread_start_us":1544,"threads_started":1}
I20260811 12:43:29.463624 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.451132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57496 (local address 127.0.186.67:33053)
0811 12:43:29.452689 (+ 1557us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.452700 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.452826 (+ 126us) server_negotiation.cc:407] Connection header received
0811 12:43:29.453165 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.453172 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.453432 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.453648 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:29.454616 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.456284 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.460107 (+ 3823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.461819 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.461944 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.462200 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.463075 (+ 875us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.463250 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1390,"thread_start_us":1810,"threads_started":1}
I20260811 12:43:29.463627 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.450268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42115 (local address 127.0.0.1:46130)
0811 12:43:29.451403 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:29.451454 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:29.451665 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:29.453312 (+ 1647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:29.453323 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:29.453367 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:29.453920 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.453937 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.456564 (+ 2627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.456570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.459910 (+ 3340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.459929 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.462390 (+ 2461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.462399 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.462635 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.462700 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 12:43:29.462889 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 12:43:29.463122 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"mutex_wait_us":103,"thread_start_us":2103,"threads_started":1}
I20260811 12:43:29.464588 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.450430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33053 (local address 127.0.0.1:57496)
0811 12:43:29.452659 (+ 2229us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:29.452680 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:29.452942 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:29.453959 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:29.453963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:29.453993 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:29.454388 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.454403 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.456493 (+ 2090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.456500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.459892 (+ 3392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.459906 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.462414 (+ 2508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.462421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.462770 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.462799 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 12:43:29.462889 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 12:43:29.464233 (+ 1344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2093,"mutex_wait_us":1745,"thread_start_us":506,"threads_started":1}
I20260811 12:43:29.466507 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.452822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41022)
0811 12:43:29.458429 (+ 5607us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:29.458450 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:29.458769 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:29.459453 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:29.459458 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:29.459485 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:29.460017 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.460029 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.461617 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.461625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.463828 (+ 2203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.463844 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.465707 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.465714 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.465886 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.465933 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 12:43:29.466031 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 12:43:29.466173 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5433,"thread_start_us":5258,"threads_started":1}
I20260811 12:43:29.466874 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.456669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41022 (local address 127.0.186.65:33959)
0811 12:43:29.457964 (+ 1295us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.457975 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.458700 (+ 725us) server_negotiation.cc:407] Connection header received
0811 12:43:29.458972 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.458980 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.459231 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.459447 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:29.460257 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.461432 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.464049 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.465470 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.465637 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.465881 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.466405 (+ 524us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.466593 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1111,"thread_start_us":958,"threads_started":1}
I20260811 12:43:29.468408 18094 tablet_service.cc:1467] Processing CreateTablet for tablet c21d86251043488e9ace4d3bf480f1b1 (DEFAULT_TABLE table=test-table [id=30a6a9ecae124dc8bb0ce59da9387d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:29.468408 17942 tablet_service.cc:1467] Processing CreateTablet for tablet c21d86251043488e9ace4d3bf480f1b1 (DEFAULT_TABLE table=test-table [id=30a6a9ecae124dc8bb0ce59da9387d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:29.469529 17789 tablet_service.cc:1467] Processing CreateTablet for tablet c21d86251043488e9ace4d3bf480f1b1 (DEFAULT_TABLE table=test-table [id=30a6a9ecae124dc8bb0ce59da9387d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:29.470080 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c21d86251043488e9ace4d3bf480f1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:29.470082 17942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c21d86251043488e9ace4d3bf480f1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:29.470799 17789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c21d86251043488e9ace4d3bf480f1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:29.479683 18182 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Bootstrap starting.
I20260811 12:43:29.482995 18182 tablet_bootstrap.cc:654] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:29.485066 18182 log.cc:824] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:29.488015 18184 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Bootstrap starting.
I20260811 12:43:29.488410 18182 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: No bootstrap required, opened a new log
I20260811 12:43:29.488698 18182 ts_tablet_manager.cc:1397] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 12:43:29.491185 18185 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Bootstrap starting.
I20260811 12:43:29.491546 18184 tablet_bootstrap.cc:654] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:29.492981 18184 log.cc:824] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:29.495201 18185 tablet_bootstrap.cc:654] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:29.496542 18184 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: No bootstrap required, opened a new log
I20260811 12:43:29.496547 18185 log.cc:824] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:29.496876 18184 ts_tablet_manager.cc:1397] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.003s
I20260811 12:43:29.497550 18182 raft_consensus.cc:348] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.498059 18182 raft_consensus.cc:374] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:29.498174 18182 raft_consensus.cc:729] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb2ebec2f0c5483d8800e2de4b7ec096, State: Initialized, Role: FOLLOWER
I20260811 12:43:29.498855 18182 consensus_queue.cc:260] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.500342 18185 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: No bootstrap required, opened a new log
I20260811 12:43:29.501034 18185 ts_tablet_manager.cc:1397] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 12:43:29.501077 18182 ts_tablet_manager.cc:1428] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 12:43:29.509006 18184 raft_consensus.cc:348] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.509541 18184 raft_consensus.cc:374] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:29.509651 18184 raft_consensus.cc:729] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3663e0a7a5a64315af31715b60a47ab2, State: Initialized, Role: FOLLOWER
I20260811 12:43:29.510354 18184 consensus_queue.cc:260] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.511754 18016 heartbeater.cc:503] Master 127.0.186.126:34025 was elected leader, sending a full tablet report...
I20260811 12:43:29.512434 18184 ts_tablet_manager.cc:1428] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Time spent starting tablet: real 0.015s user 0.012s sys 0.001s
I20260811 12:43:29.512835 18185 raft_consensus.cc:348] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.513381 18185 raft_consensus.cc:374] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:29.513496 18185 raft_consensus.cc:729] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2419db09664872bc8c49fb65b23685, State: Initialized, Role: FOLLOWER
I20260811 12:43:29.514070 18185 consensus_queue.cc:260] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.515228 18166 heartbeater.cc:503] Master 127.0.186.126:34025 was elected leader, sending a full tablet report...
I20260811 12:43:29.515857 18185 ts_tablet_manager.cc:1428] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260811 12:43:29.631345 18167 tablet.cc:2369] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:43:29.635663 17864 tablet.cc:2369] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:43:29.641737 18018 tablet.cc:2369] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:29.712033 18193 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:29.712387 18193 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.714259 18193 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65:33959)
I20260811 12:43:29.721405 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.714552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42115 (local address 127.0.186.67:40059)
0811 12:43:29.714802 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:29.714821 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:29.715017 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:29.715553 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:29.715559 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:29.715589 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:29.715796 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.715813 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.717203 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.717206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.719214 (+ 2008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.719229 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.720690 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.720694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.720895 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.720921 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 12:43:29.721001 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 12:43:29.721094 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":27}
I20260811 12:43:29.721519 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.714781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:40059 (local address 127.0.186.66:42115)
0811 12:43:29.715029 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.715035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.715061 (+ 26us) server_negotiation.cc:407] Connection header received
0811 12:43:29.715158 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.715165 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.715232 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.715340 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:29.715968 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.717026 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.719367 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.720540 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.720719 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.720823 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.721052 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.721223 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 12:43:29.722208 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.715323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:60067 (local address 127.0.186.65:33959)
0811 12:43:29.715555 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.715561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.715923 (+ 362us) server_negotiation.cc:407] Connection header received
0811 12:43:29.716087 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.716092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.716176 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.716281 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:29.716803 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.717662 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.719895 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.721162 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.721338 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.721408 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.721817 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.721952 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:43:29.722298 18194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.715063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.186.67:60067)
0811 12:43:29.715815 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:29.715832 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:29.715950 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:29.716302 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:29.716305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:29.716326 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:29.716601 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.716609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.717832 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.717837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.719752 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:29.719763 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.721368 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.721374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:29.721569 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.721607 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 12:43:29.721783 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 12:43:29.721912 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":1,"thread_start_us":379,"threads_started":1}
I20260811 12:43:29.722632 17966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c21d86251043488e9ace4d3bf480f1b1" candidate_uuid: "ff2419db09664872bc8c49fb65b23685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3663e0a7a5a64315af31715b60a47ab2" is_pre_election: true
I20260811 12:43:29.723268 17966 raft_consensus.cc:2454] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2419db09664872bc8c49fb65b23685 in term 0.
I20260811 12:43:29.723420 17812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c21d86251043488e9ace4d3bf480f1b1" candidate_uuid: "ff2419db09664872bc8c49fb65b23685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" is_pre_election: true
I20260811 12:43:29.723994 17812 raft_consensus.cc:2454] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2419db09664872bc8c49fb65b23685 in term 0.
I20260811 12:43:29.724066 18041 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3663e0a7a5a64315af31715b60a47ab2, ff2419db09664872bc8c49fb65b23685; no voters:
I20260811 12:43:29.724524 18193 raft_consensus.cc:2781] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:43:29.724721 18193 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:43:29.724871 18193 raft_consensus.cc:3037] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:29.727326 18193 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.728173 18193 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [CANDIDATE]: Term 1 election: Requested vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65:33959)
I20260811 12:43:29.728607 17966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c21d86251043488e9ace4d3bf480f1b1" candidate_uuid: "ff2419db09664872bc8c49fb65b23685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3663e0a7a5a64315af31715b60a47ab2"
I20260811 12:43:29.728742 17812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c21d86251043488e9ace4d3bf480f1b1" candidate_uuid: "ff2419db09664872bc8c49fb65b23685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096"
I20260811 12:43:29.728869 17966 raft_consensus.cc:3037] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:29.728983 17812 raft_consensus.cc:3037] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:29.732318 17812 raft_consensus.cc:2454] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2419db09664872bc8c49fb65b23685 in term 1.
I20260811 12:43:29.732318 17966 raft_consensus.cc:2454] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2419db09664872bc8c49fb65b23685 in term 1.
I20260811 12:43:29.732851 18041 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096, ff2419db09664872bc8c49fb65b23685; no voters:
I20260811 12:43:29.733176 18193 raft_consensus.cc:2781] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:29.733701 18193 raft_consensus.cc:686] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 1 LEADER]: Becoming Leader. State: Replica: ff2419db09664872bc8c49fb65b23685, State: Running, Role: LEADER
I20260811 12:43:29.734205 18193 consensus_queue.cc:237] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:29.739346 17646 catalog_manager.cc:5495] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2419db09664872bc8c49fb65b23685 (127.0.186.67). New cstate: current_term: 1 leader_uuid: "ff2419db09664872bc8c49fb65b23685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } health_report { overall_health: UNKNOWN } } }
I20260811 12:43:29.769773 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.764467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57504 (local address 127.0.186.67:33053)
0811 12:43:29.764694 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.764716 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.764786 (+ 70us) server_negotiation.cc:407] Connection header received
0811 12:43:29.764903 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.764907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.764989 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.765126 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:43:29.765467 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.766221 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.767536 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.768088 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.768187 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.768693 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:43:29.769271 (+ 578us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:43:29.769384 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.769490 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.769560 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 12:43:29.778296 17812 raft_consensus.cc:1261] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Refusing update from remote peer ff2419db09664872bc8c49fb65b23685: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:29.778299 17966 raft_consensus.cc:1261] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Refusing update from remote peer ff2419db09664872bc8c49fb65b23685: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:29.779357 18195 consensus_queue.cc:1035] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:29.779810 18193 consensus_queue.cc:1035] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:29.793238 18199 mvcc.cc:205] Tried to move back new op lower bound from 7317308251240706048 to 7317308251075481600. Current Snapshot: MvccSnapshot[applied={T|T < 7317308251240706048}]
I20260811 12:43:29.810643 17645 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:29.811055 17645 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:29.815541 17645 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Sending DeleteTablet for 3 replicas of tablet c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:29.817106 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet c21d86251043488e9ace4d3bf480f1b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:29 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:57496
I20260811 12:43:29.817094 17942 tablet_service.cc:1514] Processing DeleteTablet for tablet c21d86251043488e9ace4d3bf480f1b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:29 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:46130
I20260811 12:43:29.817793 17789 tablet_service.cc:1514] Processing DeleteTablet for tablet c21d86251043488e9ace4d3bf480f1b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:29 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:41022
I20260811 12:43:29.820075 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 17690
I20260811 12:43:29.849982 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:29.821229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41030 (local address 127.0.186.65:33959)
0811 12:43:29.821417 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:29.821423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:29.821510 (+ 87us) server_negotiation.cc:407] Connection header received
0811 12:43:29.821745 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:29.821753 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:29.821858 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:29.821971 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:29.824249 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.825867 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.828440 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:29.829526 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:29.829691 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:29.839676 (+ 9985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:29.839705 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:29.839734 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:29.839818 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:29.845510 (+ 5692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:29.846662 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:29.846677 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:29.846683 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:29.846956 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:29.847462 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:29.847469 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:29.847482 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:29.848165 (+ 683us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:29.848579 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:29.849003 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 12:43:29.849352 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 12:43:29.851372 17857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:29.850371 18214 tablet_replica.cc:330] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: stopping tablet replica
I20260811 12:43:29.866029 18213 tablet_replica.cc:330] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: stopping tablet replica
I20260811 12:43:29.867101 18212 tablet_replica.cc:330] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: stopping tablet replica
I20260811 12:43:29.867596 18212 raft_consensus.cc:2229] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:29.868206 18212 raft_consensus.cc:2258] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:29.866618 18213 raft_consensus.cc:2229] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:43:29.869709 18213 raft_consensus.cc:2258] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:29.870460 18212 ts_tablet_manager.cc:1905] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:29.874384 18213 ts_tablet_manager.cc:1905] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:29.878693 18212 ts_tablet_manager.cc:1918] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:29.879078 18212 log.cc:1196] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:29.879920 18212 ts_tablet_manager.cc:1939] T c21d86251043488e9ace4d3bf480f1b1 P 3663e0a7a5a64315af31715b60a47ab2: Deleting consensus metadata
I20260811 12:43:29.882148 17630 catalog_manager.cc:4841] TS 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): tablet c21d86251043488e9ace4d3bf480f1b1 (table test-table [id=30a6a9ecae124dc8bb0ce59da9387d34]) successfully deleted
I20260811 12:43:29.887151 18213 ts_tablet_manager.cc:1918] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:29.887555 18213 log.cc:1196] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:29.888278 18213 ts_tablet_manager.cc:1939] T c21d86251043488e9ace4d3bf480f1b1 P ff2419db09664872bc8c49fb65b23685: Deleting consensus metadata
I20260811 12:43:29.890426 17631 catalog_manager.cc:4841] TS ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): tablet c21d86251043488e9ace4d3bf480f1b1 (table test-table [id=30a6a9ecae124dc8bb0ce59da9387d34]) successfully deleted
I20260811 12:43:29.852571 18214 raft_consensus.cc:2229] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:29.986151 18214 raft_consensus.cc:2258] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:29.986326 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 17690
W20260811 12:43:30.010128 17630 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.186.65:33959 (error 108)
I20260811 12:43:30.010895 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 17867
I20260811 12:43:30.012521 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.011549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41046)
0811 12:43:30.012239 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.012346 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":444,"threads_started":1}
W20260811 12:43:30.012840 17630 catalog_manager.cc:4584] TS bb2ebec2f0c5483d8800e2de4b7ec096 (127.0.186.65:33959): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c21d86251043488e9ace4d3bf480f1b1: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
I20260811 12:43:30.029122 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.011851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.0.186.66:42115)
0811 12:43:30.012496 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:30.012502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:30.012537 (+ 35us) server_negotiation.cc:407] Connection header received
0811 12:43:30.012606 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:30.012611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:30.012707 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:30.012857 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:30.014349 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:30.015486 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:30.017055 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:30.017768 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:30.017948 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:30.021180 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:30.021205 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:30.021226 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:30.021288 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:30.025789 (+ 4501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:30.026583 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:30.026594 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:30.026598 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:30.026790 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:30.027197 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:30.027203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:30.027207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:30.027774 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:30.028110 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:30.028326 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 12:43:30.028591 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505}
I20260811 12:43:30.029866 18011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:30.066654 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.066036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41056)
0811 12:43:30.066307 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.066439 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 12:43:30.067976 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.067542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41062)
0811 12:43:30.067720 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.067809 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 12:43:30.125339 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 17867
I20260811 12:43:30.128722 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.128236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41072)
0811 12:43:30.128450 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.128549 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 12:43:30.129963 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.129564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41074)
0811 12:43:30.129740 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.129819 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 12:43:30.159950 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 18020
I20260811 12:43:30.175204 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.160952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57506 (local address 127.0.186.67:33053)
0811 12:43:30.161196 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:30.161202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:30.161224 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:43:30.161354 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:30.161359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:30.161438 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:30.161554 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:30.162943 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:30.163811 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:30.165246 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:30.165698 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:30.165848 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:30.168625 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:30.168639 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:30.168654 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:30.168694 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:30.172057 (+ 3363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:30.172894 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:30.172901 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:30.172904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:30.173064 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:30.173528 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:30.173532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:30.173534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:30.173902 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:30.174263 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:30.174538 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 12:43:30.174778 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 12:43:30.175952 18160 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:30.211475 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.210888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41088)
0811 12:43:30.211166 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.211288 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 12:43:30.212898 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.212351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41104)
0811 12:43:30.212592 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.212689 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260811 12:43:30.305958 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 18020
I20260811 12:43:30.333858 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 17609
I20260811 12:43:30.335067 17682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:30.454908 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:30.454463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:33959 (local address 127.0.0.1:41116)
0811 12:43:30.454653 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:30.454755 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 12:43:30.455744 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 17609
I20260811 12:43:30.485137 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34025
--webserver_interface=127.0.186.126
--webserver_port=35019
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:34025
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:30.852197 18222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:30.852533 18222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:30.852694 18222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:30.860637 18222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:30.860831 18222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:30.860942 18222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:30.861044 18222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:30.861110 18222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:30.871704 18222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:34025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:34025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=35019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:30.873205 18222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:30.874622 18222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:30.887761 18231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:30.887830 18229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:30.887794 18228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:30.888679 18222 server_base.cc:1034] running on GCE node
I20260811 12:43:30.889541 18222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:30.891094 18222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:30.892315 18222 hybrid_clock.cc:648] HybridClock initialized: now 1786452210892267 us; error 34 us; skew 500 ppm
I20260811 12:43:30.892699 18222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:30 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452210, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:30.896023 18222 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:30.897704 18222 webserver.cc:460] Webserver started at http://127.0.186.126:35019/ using document root <none> and password file <none>
I20260811 12:43:30.898372 18222 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:30.898524 18222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:30.904327 18222 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 12:43:30.907347 18238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:30.908874 18222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:43:30.909057 18222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "16269073447244499cabb54331e8a21f"
format_stamp: "Formatted at 2026-08-11 12:43:24 on dist-test-slave-qg60"
server_key: "8f6231ccf3899e6047d7e218200d2c40"
server_key_iv: "0aecc91d3001e2d1a16526535369f0b8"
server_key_version: "encryptionkey@0"
I20260811 12:43:30.910111 18222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:30.935676 18222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:30.940339 18222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:30.940670 18222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:30.961031 18222 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:34025
I20260811 12:43:30.961051 18295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:34025 every 8 connection(s)
I20260811 12:43:30.962695 18222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:30.970357 18297 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:43:30.970394 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18222
I20260811 12:43:30.971308 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:33959
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:34025
--webserver_port=46419
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:30.973974 18297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap starting.
I20260811 12:43:30.995450 18297 log.cc:824] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:31.016378 18297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:43:31.017143 18297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f: Bootstrap complete.
I20260811 12:43:31.026932 18297 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:31.027902 18297 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16269073447244499cabb54331e8a21f, State: Initialized, Role: FOLLOWER
I20260811 12:43:31.028522 18297 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:31.028800 18297 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:31.028954 18297 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:31.029135 18297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 2 FOLLOWER]: Advancing to term 3
I20260811 12:43:31.033247 18297 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:31.033804 18297 leader_election.cc:302] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16269073447244499cabb54331e8a21f; no voters:
I20260811 12:43:31.034538 18297 leader_election.cc:288] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 12:43:31.034708 18302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 3 FOLLOWER]: Leader election won for term 3
I20260811 12:43:31.035991 18302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [term 3 LEADER]: Becoming Leader. State: Replica: 16269073447244499cabb54331e8a21f, State: Running, Role: LEADER
I20260811 12:43:31.036712 18302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } }
I20260811 12:43:31.037184 18297 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:31.039784 18304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16269073447244499cabb54331e8a21f. Latest consensus state: current_term: 3 leader_uuid: "16269073447244499cabb54331e8a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } } }
I20260811 12:43:31.040213 18304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:31.039816 18303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "16269073447244499cabb54331e8a21f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16269073447244499cabb54331e8a21f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 34025 } } }
I20260811 12:43:31.040926 18303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16269073447244499cabb54331e8a21f [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:31.043931 18307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:31.053656 18307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:31.055387 18307 catalog_manager.cc:1259] Loaded cluster ID: 2d39666340f743de9c7dcafa5fa82f82
I20260811 12:43:31.055588 18307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 12:43:31.058033 18307 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0e7fbb39ad google::LogMessage::Fail() at ??:0
@ 0x7f0e7fbb688a google::LogMessage::SendToLog() at ??:0
@ 0x7f0e7fbb34de google::LogMessage::Flush() at ??:0
@ 0x7f0e7fbb4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0e955ea512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f0e955e7976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0e9566f610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f0e9566f439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0e827ff345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0e8280291c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f0e82802799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0e827ddeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0e85ab76db start_thread at ??:0
@ 0x7f0e7ea4d61f clone at ??:0
W20260811 12:43:31.442826 18299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:31.443145 18299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:31.443269 18299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:31.451720 18299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:31.451905 18299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:31.452049 18299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:43:31.464845 18299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:33959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=46419
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:31.466351 18299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:31.467844 18299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:31.482685 18344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:31.482713 18346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:31.483021 18348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:31.483513 18299 server_base.cc:1034] running on GCE node
I20260811 12:43:31.484167 18299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:31.485355 18299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:31.486567 18299 hybrid_clock.cc:648] HybridClock initialized: now 1786452211486513 us; error 42 us; skew 500 ppm
I20260811 12:43:31.486913 18299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:31 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452211, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:31.490370 18299 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:43:31.491852 18299 webserver.cc:460] Webserver started at http://127.0.186.65:46419/ using document root <none> and password file <none>
I20260811 12:43:31.492529 18299 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:31.492638 18299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:31.498430 18299 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 12:43:31.501498 18358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:31.502913 18299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 12:43:31.503113 18299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "bb2ebec2f0c5483d8800e2de4b7ec096"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "bd6329afa5d74b9eb81e29e4d7207515"
server_key_iv: "bbcbd821f8beda8b4168939ae3d3b07c"
server_key_version: "encryptionkey@0"
I20260811 12:43:31.504248 18299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:31.539527 18299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:31.544080 18299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:31.544380 18299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:31.545629 18299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:31.547597 18366 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 12:43:31.553541 18299 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 12:43:31.553666 18299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260811 12:43:31.553849 18299 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 12:43:31.557114 18299 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 12:43:31.557192 18299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.003s
I20260811 12:43:31.557550 18366 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Bootstrap starting.
I20260811 12:43:31.587807 18366 log.cc:824] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:31.600277 18299 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:33959
I20260811 12:43:31.600284 18489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:33959 every 8 connection(s)
I20260811 12:43:31.602159 18299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:43:31.605707 18366 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:43:31.606417 18366 tablet_bootstrap.cc:492] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Bootstrap complete.
I20260811 12:43:31.607710 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:31.605259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:44257)
0811 12:43:31.606192 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:31.606581 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":403,"threads_started":1}
I20260811 12:43:31.607971 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18299
I20260811 12:43:31.608155 18366 ts_tablet_manager.cc:1397] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Time spent bootstrapping tablet: real 0.051s user 0.030s sys 0.016s
I20260811 12:43:31.608856 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:42115
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:34025
--webserver_port=38893
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:31.608929 18490 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:34025 (0 consecutive failures): Network error: Failed to ping master at 127.0.186.126:34025: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
I20260811 12:43:31.610005 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:31.609531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:44091)
0811 12:43:31.609727 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:31.609832 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 12:43:31.611250 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:31.610747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:38325)
0811 12:43:31.610944 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:31.611053 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 12:43:31.611660 18490 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 12:43:31.616575 18366 raft_consensus.cc:348] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:31.617842 18366 raft_consensus.cc:729] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb2ebec2f0c5483d8800e2de4b7ec096, State: Initialized, Role: FOLLOWER
I20260811 12:43:31.618647 18366 consensus_queue.cc:260] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:31.620448 18366 ts_tablet_manager.cc:1428] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096: Time spent starting tablet: real 0.012s user 0.007s sys 0.007s
I20260811 12:43:31.620797 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:31.620179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:43229)
0811 12:43:31.620401 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:31.620522 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 12:43:31.621848 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:31.621486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:39447)
0811 12:43:31.621653 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:31.621724 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 12:43:31.971791 18494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:31.972111 18494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:31.972213 18494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:31.979818 18494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:31.979962 18494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:31.980082 18494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:43:31.990218 18494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:42115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=38893
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:31.991575 18494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:31.992942 18494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:32.007477 18501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:32.007521 18502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:32.007477 18504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:32.013862 18494 server_base.cc:1034] running on GCE node
I20260811 12:43:32.014690 18494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:32.015858 18494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:32.017156 18494 hybrid_clock.cc:648] HybridClock initialized: now 1786452212017107 us; error 48 us; skew 500 ppm
I20260811 12:43:32.017558 18494 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:32 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452212, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:32.021365 18494 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:43:32.023253 18494 webserver.cc:460] Webserver started at http://127.0.186.66:38893/ using document root <none> and password file <none>
I20260811 12:43:32.024075 18494 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:32.024245 18494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:32.031221 18494 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 12:43:32.034375 18512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:32.035953 18494 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:43:32.036181 18494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "3663e0a7a5a64315af31715b60a47ab2"
format_stamp: "Formatted at 2026-08-11 12:43:25 on dist-test-slave-qg60"
server_key: "dadb69beee3e70d1982c6930efe1a47b"
server_key_iv: "207a939b709b7be2323f809e8d66bc92"
server_key_version: "encryptionkey@0"
I20260811 12:43:32.037405 18494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:32.071432 18494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:32.076619 18494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:32.077051 18494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:32.078291 18494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:32.079866 18494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:32.079981 18494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:32.080068 18494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:32.080122 18494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:32.118571 18494 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:42115
I20260811 12:43:32.118664 18639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:42115 every 8 connection(s)
I20260811 12:43:32.120216 18494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:43:32.123947 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18494
I20260811 12:43:32.124887 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:33053
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:34025
--webserver_port=42893
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:35375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:32.126446 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.123770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:53629)
0811 12:43:32.124827 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.125188 (+ 361us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":374,"threads_started":1}
W20260811 12:43:32.127278 18640 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:34025 (0 consecutive failures): Network error: Failed to ping master at 127.0.186.126:34025: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
I20260811 12:43:32.128404 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.127933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:39449)
0811 12:43:32.128140 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.128242 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 12:43:32.129496 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.129047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:40959)
0811 12:43:32.129225 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.129330 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 12:43:32.129930 18640 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 12:43:32.486291 18643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:32.486630 18643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:32.486801 18643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:32.494611 18643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:32.494751 18643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:32.494978 18643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:43:32.505595 18643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:35375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:33053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=42893
--tserver_master_addrs=127.0.186.126:34025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:32.507059 18643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:32.508637 18643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:32.523325 18650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:32.523259 18653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:32.523350 18651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:32.524298 18643 server_base.cc:1034] running on GCE node
I20260811 12:43:32.525058 18643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:32.526101 18643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:32.527339 18643 hybrid_clock.cc:648] HybridClock initialized: now 1786452212527289 us; error 47 us; skew 500 ppm
I20260811 12:43:32.527690 18643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:32 dist-test-slave-qg60 krb5kdc[16967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452212, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:32.531054 18643 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:43:32.532721 18643 webserver.cc:460] Webserver started at http://127.0.186.67:42893/ using document root <none> and password file <none>
I20260811 12:43:32.533507 18643 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:32.533661 18643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:32.539630 18643 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 12:43:32.542958 18660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:32.544309 18643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:43:32.544505 18643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "ff2419db09664872bc8c49fb65b23685"
format_stamp: "Formatted at 2026-08-11 12:43:26 on dist-test-slave-qg60"
server_key: "eb0a299ba7e7a3dd395d5df29a8794b8"
server_key_iv: "97f36fcc370f1476c52ba239de196aa3"
server_key_version: "encryptionkey@0"
I20260811 12:43:32.545619 18643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:32.563588 18643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:32.567767 18643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:32.568081 18643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:32.569159 18643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:32.570665 18643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:32.570791 18643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:32.570928 18643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:32.571020 18643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:32.606515 18643 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:33053
I20260811 12:43:32.606626 18793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:33053 every 8 connection(s)
I20260811 12:43:32.608366 18643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:43:32.610797 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18643
I20260811 12:43:32.614166 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.611731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:50305)
0811 12:43:32.613036 (+ 1305us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.613282 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":697,"threads_started":1}
W20260811 12:43:32.614918 18794 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:34025 (0 consecutive failures): Network error: Failed to ping master at 127.0.186.126:34025: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
I20260811 12:43:32.615792 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.615410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:41579)
0811 12:43:32.615582 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.615664 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 12:43:32.616838 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.616369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:50683)
0811 12:43:32.616535 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.616622 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 12:43:32.617134 18794 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 12:43:32.623718 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:32.622736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:51283)
0811 12:43:32.623304 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:32.623435 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":232,"threads_started":1}
I20260811 12:43:33.131449 18800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.130565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:33513)
0811 12:43:33.131088 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:33.131189 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":251,"threads_started":1}
I20260811 12:43:33.451574 18801 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:33.451932 18801 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:33.453707 18801 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
Aug 11 12:43:33 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452211, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
Aug 11 12:43:33 dist-test-slave-qg60 krb5kdc[16967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452211, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:43:33.495060 18803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.453977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:42115 (local address 127.0.186.65:59895)
0811 12:43:33.466340 (+ 12363us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:33.466432 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:33.467666 (+ 1234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:33.472462 (+ 4796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:33.472472 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:33.473638 (+ 1166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:33.474887 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:33.474919 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.476708 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.476713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:33.478054 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:33.478068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.479208 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.479216 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:33.479570 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:33.480362 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:33.480386 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:33.483917 (+ 3531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:33.489876 (+ 5959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:33.489888 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:33.489905 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:33.490800 (+ 895us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:33.491416 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:33.491421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:33.491426 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:33.491806 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:33.492999 (+ 1193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:33.493008 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:33.493524 (+ 516us) client_negotiation.cc:769] Sending connection context
0811 12:43:33.493891 (+ 367us) client_negotiation.cc:240] Negotiation successful
0811 12:43:33.494501 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12142,"mutex_wait_us":232,"spinlock_wait_cycles":45184,"thread_start_us":13731,"threads_started":1}
I20260811 12:43:33.495235 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.454468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:33625 (local address 127.0.186.67:33053)
0811 12:43:33.467656 (+ 13188us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:33.467674 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:33.468799 (+ 1125us) server_negotiation.cc:407] Connection header received
0811 12:43:33.471268 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:33.471283 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:33.471871 (+ 588us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:33.472303 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:33.476793 (+ 4490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.478115 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.479638 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.480551 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.480698 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:33.484853 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:33.484865 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:33.484884 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:33.484946 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:33.489683 (+ 4737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:33.490992 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:33.491004 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:33.491020 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:33.491272 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:33.491943 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:33.491948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:33.491952 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:33.492824 (+ 872us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:33.493063 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:33.494350 (+ 1287us) server_negotiation.cc:299] Negotiation successful
0811 12:43:33.494746 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12968,"thread_start_us":12834,"threads_started":1}
I20260811 12:43:33.495226 18805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.454444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:59895 (local address 127.0.186.66:42115)
0811 12:43:33.468781 (+ 14337us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:33.468796 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:33.468846 (+ 50us) server_negotiation.cc:407] Connection header received
0811 12:43:33.471365 (+ 2519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:33.471376 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:33.471872 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:33.472303 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:33.475116 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.476478 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.478226 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.478991 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.479157 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:33.484299 (+ 5142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:33.484308 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:33.484324 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:33.484367 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:33.489657 (+ 5290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:33.490993 (+ 1336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:33.491004 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:33.491012 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:33.491270 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:33.491943 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:33.491948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:33.491952 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:33.492824 (+ 872us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:33.493056 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:33.494245 (+ 1189us) server_negotiation.cc:299] Negotiation successful
0811 12:43:33.494746 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14042,"thread_start_us":13718,"threads_started":1}
I20260811 12:43:33.495098 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.454045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:33053 (local address 127.0.186.65:33625)
0811 12:43:33.468601 (+ 14556us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:33.468621 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:33.468740 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:33.472873 (+ 4133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:33.472881 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:33.473638 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:33.474887 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:33.474919 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.478303 (+ 3384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.478306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:33.479472 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:33.479487 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:33.480814 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:33.480827 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:33.481013 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:33.481792 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:33.481826 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:33.484495 (+ 2669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:33.489876 (+ 5381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:33.489888 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:33.489905 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:33.490800 (+ 895us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:33.491416 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:33.491421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:33.491426 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:33.491806 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:33.493046 (+ 1240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:33.493050 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:33.493522 (+ 472us) client_negotiation.cc:769] Sending connection context
0811 12:43:33.493891 (+ 369us) client_negotiation.cc:240] Negotiation successful
0811 12:43:33.494673 (+ 782us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14408,"mutex_wait_us":396,"spinlock_wait_cycles":33664,"thread_start_us":13028,"threads_started":1}
W20260811 12:43:33.499063 18361 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
W20260811 12:43:33.499351 18360 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:33.499527 18360 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096; no voters: 3663e0a7a5a64315af31715b60a47ab2, ff2419db09664872bc8c49fb65b23685
I20260811 12:43:33.499981 18801 raft_consensus.cc:2726] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:43:33.618862 18806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.617765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:45819)
0811 12:43:33.618391 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:33.618576 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":344,"threads_started":1}
I20260811 12:43:33.625293 18803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:33.624846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:35199)
0811 12:43:33.625016 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:33.625125 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 12:43:34.133375 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:34.132581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:50933)
0811 12:43:34.133117 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:34.133209 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":299,"threads_started":1}
I20260811 12:43:34.620841 18808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:34.620065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:36069)
0811 12:43:34.620514 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:34.620621 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":243,"threads_started":1}
I20260811 12:43:34.627346 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:34.626243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:59355)
0811 12:43:34.627041 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:34.627139 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":412,"threads_started":1}
I20260811 12:43:35.135139 18810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:35.134378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:45491)
0811 12:43:35.134869 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:35.134958 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":249,"threads_started":1}
I20260811 12:43:35.245712 18811 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:35.245934 18811 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:35.246636 18811 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
W20260811 12:43:35.247860 18361 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
W20260811 12:43:35.248102 18360 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:35.248224 18360 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096; no voters: 3663e0a7a5a64315af31715b60a47ab2, ff2419db09664872bc8c49fb65b23685
I20260811 12:43:35.248452 18811 raft_consensus.cc:2726] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:43:35.622605 18812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:35.621824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:34687)
0811 12:43:35.622336 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:35.622425 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":267,"threads_started":1}
I20260811 12:43:35.629235 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:35.628293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:39877)
0811 12:43:35.628832 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:35.629025 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":228,"threads_started":1}
I20260811 12:43:36.136864 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:36.136045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:55295)
0811 12:43:36.136520 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:36.136613 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":233,"threads_started":1}
I20260811 12:43:36.624639 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:36.623672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:59315)
0811 12:43:36.624339 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:36.624436 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":404,"threads_started":1}
I20260811 12:43:36.631314 18816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:36.630465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:37245)
0811 12:43:36.631009 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:36.631105 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":278,"threads_started":1}
I20260811 12:43:36.848062 18817 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:36.848315 18817 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:36.849228 18817 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
W20260811 12:43:36.850320 18360 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
W20260811 12:43:36.850526 18361 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:36.850703 18361 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096; no voters: 3663e0a7a5a64315af31715b60a47ab2, ff2419db09664872bc8c49fb65b23685
I20260811 12:43:36.850988 18817 raft_consensus.cc:2726] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:43:37.138685 18819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:37.137842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:60085)
0811 12:43:37.138355 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:37.138444 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":261,"threads_started":1}
I20260811 12:43:37.627499 18821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:37.626301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:56673)
0811 12:43:37.627089 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:37.627220 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":443,"threads_started":1}
I20260811 12:43:37.633867 18822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:37.632576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:53597)
0811 12:43:37.633450 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:37.633609 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":535,"threads_started":1}
I20260811 12:43:38.142464 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:38.140441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:52797)
0811 12:43:38.141723 (+ 1282us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:38.141950 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1078,"thread_start_us":631,"threads_started":1}
I20260811 12:43:38.630347 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:38.629043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:45501)
0811 12:43:38.629820 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:38.629960 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":392,"threads_started":1}
I20260811 12:43:38.637215 18825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:38.635596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:57807)
0811 12:43:38.636494 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:38.636683 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":523,"threads_started":1}
I20260811 12:43:39.144847 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:39.143884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:57329)
0811 12:43:39.144463 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:39.144566 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":252,"threads_started":1}
I20260811 12:43:39.496850 18827 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:39.497084 18827 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:39.498124 18827 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
W20260811 12:43:39.499243 18361 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
W20260811 12:43:39.499400 18360 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:39.499548 18360 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096; no voters: 3663e0a7a5a64315af31715b60a47ab2, ff2419db09664872bc8c49fb65b23685
I20260811 12:43:39.499833 18827 raft_consensus.cc:2726] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:43:39.632517 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:39.631549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:35767)
0811 12:43:39.632212 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:39.632309 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":260,"threads_started":1}
I20260811 12:43:39.639178 18829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:39.638320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:56209)
0811 12:43:39.638812 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:39.638922 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":246,"threads_started":1}
I20260811 12:43:40.146554 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:40.145752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:40441)
0811 12:43:40.146269 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:40.146357 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":277,"threads_started":1}
I20260811 12:43:40.634241 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:40.633508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:39011)
0811 12:43:40.633956 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:40.634052 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":242,"threads_started":1}
I20260811 12:43:40.640991 18832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:40.640140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:55691)
0811 12:43:40.640650 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:40.640781 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":237,"threads_started":1}
I20260811 12:43:41.148305 18833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:41.147502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:41145)
0811 12:43:41.148021 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:41.148139 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":241,"threads_started":1}
I20260811 12:43:41.636363 18834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:41.635294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:35909)
0811 12:43:41.635981 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:41.636111 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":336,"threads_started":1}
I20260811 12:43:41.643041 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:41.642272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:42339)
0811 12:43:41.642775 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:41.642864 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":244,"threads_started":1}
I20260811 12:43:42.150321 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:42.149409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:44557)
0811 12:43:42.149985 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:42.150132 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":271,"threads_started":1}
I20260811 12:43:42.409767 18837 raft_consensus.cc:482] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:42.409966 18837 raft_consensus.cc:504] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3663e0a7a5a64315af31715b60a47ab2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 42115 } } peers { permanent_uuid: "ff2419db09664872bc8c49fb65b23685" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 33053 } } peers { permanent_uuid: "bb2ebec2f0c5483d8800e2de4b7ec096" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 33959 } }
I20260811 12:43:42.410674 18837 leader_election.cc:288] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115), ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053)
W20260811 12:43:42.411800 18361 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff2419db09664872bc8c49fb65b23685 (127.0.186.67:33053): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
W20260811 12:43:42.411995 18360 leader_election.cc:341] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3663e0a7a5a64315af31715b60a47ab2 (127.0.186.66:42115): Not found: Tablet not found: c21d86251043488e9ace4d3bf480f1b1
I20260811 12:43:42.412135 18360 leader_election.cc:302] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb2ebec2f0c5483d8800e2de4b7ec096; no voters: 3663e0a7a5a64315af31715b60a47ab2, ff2419db09664872bc8c49fb65b23685
I20260811 12:43:42.412412 18837 raft_consensus.cc:2726] T c21d86251043488e9ace4d3bf480f1b1 P bb2ebec2f0c5483d8800e2de4b7ec096 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:43:42.638273 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:42.637450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:42145)
0811 12:43:42.637924 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:42.638068 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":247,"threads_started":1}
I20260811 12:43:42.644908 18840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:42.643974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:49695)
0811 12:43:42.644504 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:42.644606 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":262,"threads_started":1}
I20260811 12:43:43.152230 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:43.151400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:41607)
0811 12:43:43.151918 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:43.152050 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":252,"threads_started":1}
I20260811 12:43:43.640540 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:43.639553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:43119)
0811 12:43:43.640222 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:43.640342 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":329,"threads_started":1}
I20260811 12:43:43.646872 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:43.646053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:59781)
0811 12:43:43.646590 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:43.646695 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":288,"threads_started":1}
I20260811 12:43:44.154140 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:44.153319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:59093)
0811 12:43:44.153823 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:44.153922 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":283,"threads_started":1}
I20260811 12:43:44.642499 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:44.641601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:55629)
0811 12:43:44.642133 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:44.642239 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":267,"threads_started":1}
I20260811 12:43:44.649116 18848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:44.647980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:48909)
0811 12:43:44.648561 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:44.648706 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":306,"threads_started":1}
I20260811 12:43:45.156198 18849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:45.155189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:45247)
0811 12:43:45.155737 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:45.155842 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":286,"threads_started":1}
I20260811 12:43:45.644245 18850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:45.643520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:47733)
0811 12:43:45.643973 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:45.644074 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":239,"threads_started":1}
I20260811 12:43:45.651046 18851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:45.650048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:36169)
0811 12:43:45.650731 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:45.650841 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":262,"threads_started":1}
I20260811 12:43:46.158082 18852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:46.157292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:34731)
0811 12:43:46.157776 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:46.157867 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":245,"threads_started":1}
I20260811 12:43:46.646303 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:46.645481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:54059)
0811 12:43:46.645971 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:46.646101 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":248,"threads_started":1}
I20260811 12:43:46.653231 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:46.652264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:34413)
0811 12:43:46.652928 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:46.653037 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":327,"threads_started":1}
I20260811 12:43:47.160161 18855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:47.159368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.66:43381)
0811 12:43:47.159877 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:47.159968 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":275,"threads_started":1}
I20260811 12:43:47.614502 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 18299
I20260811 12:43:47.632265 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:47.616342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54750 (local address 127.0.186.65:33959)
0811 12:43:47.617328 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:47.617336 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:47.617364 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:43:47.617441 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:47.617448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:47.617684 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:47.617824 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:47.619511 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:47.620618 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:47.622209 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:47.622842 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:47.623033 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:47.626194 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:47.626212 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:47.626234 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:47.626271 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:47.629281 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:47.630050 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:47.630057 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:47.630060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:47.630222 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:47.630578 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:47.630582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:47.630585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:47.630954 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:47.631236 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:47.631632 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 12:43:47.631939 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":806,"thread_start_us":633,"threads_started":1}
I20260811 12:43:47.633790 18485 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:47.648783 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:47.647732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.67:59487)
0811 12:43:47.648451 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:47.648552 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":441,"threads_started":1}
I20260811 12:43:47.727573 18860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:47.726383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:34025 (local address 127.0.186.65:53751)
0811 12:43:47.726942 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:47.727164 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":272,"threads_started":1}
I20260811 12:43:47.727607 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 18299
I20260811 12:43:47.752831 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 18494
I20260811 12:43:47.767302 18861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:47.753702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59428 (local address 127.0.186.66:42115)
0811 12:43:47.754297 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:47.754302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:47.754325 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:43:47.754379 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:47.754383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:47.754449 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:47.754570 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:47.756196 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:47.757055 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:47.758405 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:47.758852 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:47.758987 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:47.761911 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:47.761916 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:47.761919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:47.761956 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:47.764521 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:47.765274 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:47.765284 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:47.765287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:47.765410 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:47.765823 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:47.765828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:47.765831 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:47.766121 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:47.766405 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:47.766691 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 12:43:47.766916 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":311,"threads_started":1}
I20260811 12:43:47.768165 18633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:47.855656 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 18494
I20260811 12:43:47.880100 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 18643
I20260811 12:43:47.896230 18864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:47.881314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54402 (local address 127.0.186.67:33053)
0811 12:43:47.881976 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:47.881981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:47.881999 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:43:47.882061 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:47.882066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:47.882140 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:47.882280 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:47.884054 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:47.885036 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:47.886481 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:47.887011 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:47.887171 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:47.890241 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:47.890247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:47.890250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:47.890291 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:47.893322 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:47.894075 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:47.894088 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:47.894091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:47.894252 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:47.894662 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:47.894667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:47.894672 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:47.894967 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:47.895285 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:47.895566 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 12:43:47.895804 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":376,"threads_started":1}
I20260811 12:43:47.897135 18788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:47.985088 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 18643
2026-08-11T12:43:48Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25373 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:43:48 dist-test-slave-qg60 krb5kdc[18868](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:43:48 dist-test-slave-qg60 krb5kdc[18868](info): set up 2 sockets
Aug 11 12:43:48 dist-test-slave-qg60 krb5kdc[18868](info): commencing operation
krb5kdc: starting...
W20260811 12:43:49.227216 745 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:43:49 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:43:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:43:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:43:49.581399 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35823
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:49.938911 18884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:49.939276 18884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:49.939432 18884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:49.946981 18884 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 12:43:49.947142 18884 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 12:43:49.947233 18884 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 12:43:49.947332 18884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:43:49.947431 18884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:49.947568 18884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:49.947670 18884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:43:49.947745 18884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:43:49.958019 18884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:49.959455 18884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:49.960958 18884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:49.974648 18891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:49.974702 18894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:49.974599 18892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:49.978431 18884 server_base.cc:1034] running on GCE node
I20260811 12:43:49.979364 18884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:49.981050 18884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:49.982288 18884 hybrid_clock.cc:648] HybridClock initialized: now 1786452229982228 us; error 32 us; skew 500 ppm
I20260811 12:43:49.982681 18884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:49 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452229, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:49.992439 18884 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:43:49.994369 18884 webserver.cc:460] Webserver started at http://127.0.186.126:32909/ using document root <none> and password file <none>
I20260811 12:43:49.995210 18884 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:49.995355 18884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:49.995728 18884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:49.999086 18884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "2a2e6da5293a4f7b9712bca52d219bbf"
format_stamp: "Formatted at 2026-08-11 12:43:49 on dist-test-slave-qg60"
server_key: "132f030bc57851a7de1320641ba43d66"
server_key_iv: "377dde5e3b8bb6b720ba3dba5ada9b79"
server_key_version: "encryptionkey@0"
I20260811 12:43:49.999969 18884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "2a2e6da5293a4f7b9712bca52d219bbf"
format_stamp: "Formatted at 2026-08-11 12:43:49 on dist-test-slave-qg60"
server_key: "132f030bc57851a7de1320641ba43d66"
server_key_iv: "377dde5e3b8bb6b720ba3dba5ada9b79"
server_key_version: "encryptionkey@0"
I20260811 12:43:50.005952 18884 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 12:43:50.010197 18902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:50.011842 18884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:43:50.012194 18884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "2a2e6da5293a4f7b9712bca52d219bbf"
format_stamp: "Formatted at 2026-08-11 12:43:49 on dist-test-slave-qg60"
server_key: "132f030bc57851a7de1320641ba43d66"
server_key_iv: "377dde5e3b8bb6b720ba3dba5ada9b79"
server_key_version: "encryptionkey@0"
I20260811 12:43:50.012496 18884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:50.032218 18884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:50.036717 18884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:50.037047 18884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:50.057142 18884 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35823
I20260811 12:43:50.057161 18957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35823 every 8 connection(s)
I20260811 12:43:50.058559 18884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:43:50.062577 18959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:50.066421 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18884
I20260811 12:43:50.066699 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:43:50.067562 745 external_mini_cluster.cc:1428] Setting key 39052921ef527b8df4390a4e318e174c
I20260811 12:43:50.076977 18959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap starting.
I20260811 12:43:50.081209 18959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:50.083253 18959 log.cc:824] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Log is configured to *not* fsync() on all Append() calls
Aug 11 12:43:50 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:50.086597 18959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: No bootstrap required, opened a new log
I20260811 12:43:50.093466 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:50.069889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47602 (local address 127.0.186.126:35823)
0811 12:43:50.070754 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:50.070765 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:50.070809 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:43:50.072488 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:50.072509 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:50.072979 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:50.073319 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:50.075219 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:50.076522 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:50.078608 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:50.079336 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:50.079471 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:50.085032 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:50.085040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:50.085056 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:50.085095 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:50.088476 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:50.089592 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:50.089600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:50.089608 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:50.089806 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:50.090263 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:50.090266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:50.090268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:50.090933 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:50.091205 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:50.091720 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 12:43:50.092189 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":443,"threads_started":1}
I20260811 12:43:50.096232 18959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:43:50.096750 18959 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:50.096872 18959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a2e6da5293a4f7b9712bca52d219bbf, State: Initialized, Role: FOLLOWER
I20260811 12:43:50.097461 18959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:43:50.097707 18959 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:43:50.097864 18959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:43:50.098047 18959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:50.100387 18959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:43:50.100968 18959 leader_election.cc:302] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a2e6da5293a4f7b9712bca52d219bbf; no voters:
I20260811 12:43:50.101707 18959 leader_election.cc:288] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:43:50.101840 18966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:50.103046 18966 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 LEADER]: Becoming Leader. State: Replica: 2a2e6da5293a4f7b9712bca52d219bbf, State: Running, Role: LEADER
I20260811 12:43:50.103600 18966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:43:50.104125 18959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:43:50.106753 18968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a2e6da5293a4f7b9712bca52d219bbf. Latest consensus state: current_term: 1 leader_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } } }
I20260811 12:43:50.107188 18968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:50.106564 18967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } } }
I20260811 12:43:50.108028 18967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: This master's current role is: LEADER
I20260811 12:43:50.113337 18972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:43:50.119889 18972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:43:50.129518 18972 catalog_manager.cc:1347] Generated new cluster ID: 70dc876803a642a9a0d482874edbc5df
I20260811 12:43:50.129652 18972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:43:50.150524 18972 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:43:50.152177 18972 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:43:50.159992 18972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Generated new TSK 0
I20260811 12:43:50.161209 18972 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:43:50.264242 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35823
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:50.644595 18987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:50.645032 18987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:50.645152 18987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:50.652885 18987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:50.653016 18987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:50.653151 18987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:43:50.664073 18987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:50.665510 18987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:50.666865 18987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:50.681270 18993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:50.681264 18994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:50.681277 18996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:50.682279 18987 server_base.cc:1034] running on GCE node
I20260811 12:43:50.682943 18987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:50.683940 18987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:50.685164 18987 hybrid_clock.cc:648] HybridClock initialized: now 1786452230685092 us; error 61 us; skew 500 ppm
I20260811 12:43:50.685523 18987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:50 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452230, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:50.689106 18987 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:43:50.690681 18987 webserver.cc:460] Webserver started at http://127.0.186.65:40889/ using document root <none> and password file <none>
I20260811 12:43:50.691421 18987 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:50.691584 18987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:50.691915 18987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:50.695060 18987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "2b7fb00fdf1042189b861e3645dd7c04"
format_stamp: "Formatted at 2026-08-11 12:43:50 on dist-test-slave-qg60"
server_key: "c5c15dc6a5ffb7aba705fb5d10a79566"
server_key_iv: "7e102c750b6f4a249681fa5b084c96c4"
server_key_version: "encryptionkey@0"
I20260811 12:43:50.695886 18987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "2b7fb00fdf1042189b861e3645dd7c04"
format_stamp: "Formatted at 2026-08-11 12:43:50 on dist-test-slave-qg60"
server_key: "c5c15dc6a5ffb7aba705fb5d10a79566"
server_key_iv: "7e102c750b6f4a249681fa5b084c96c4"
server_key_version: "encryptionkey@0"
I20260811 12:43:50.701490 18987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 12:43:50.705407 19003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:50.707067 18987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:43:50.707291 18987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "2b7fb00fdf1042189b861e3645dd7c04"
format_stamp: "Formatted at 2026-08-11 12:43:50 on dist-test-slave-qg60"
server_key: "c5c15dc6a5ffb7aba705fb5d10a79566"
server_key_iv: "7e102c750b6f4a249681fa5b084c96c4"
server_key_version: "encryptionkey@0"
I20260811 12:43:50.707558 18987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:50.729663 18987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:50.734965 18987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:50.735321 18987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:50.736696 18987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:50.738633 18987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:50.738719 18987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:50.738886 18987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:50.739002 18987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:50.782169 18987 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:39683
I20260811 12:43:50.782308 19134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:39683 every 8 connection(s)
I20260811 12:43:50.783689 18987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:43:50.790416 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 18987
I20260811 12:43:50.790683 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:43:50.791711 745 external_mini_cluster.cc:1428] Setting key efeb77ec8fd59d818d2fd1773a8dbf4c
Aug 11 12:43:50 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452230, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:50.807260 19137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:50.786807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:44187 (local address 127.0.186.126:35823)
0811 12:43:50.787309 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:50.787316 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:50.788600 (+ 1284us) server_negotiation.cc:407] Connection header received
0811 12:43:50.791302 (+ 2702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:50.791308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:50.791430 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:50.791554 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:50.793834 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:50.794633 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:50.796388 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:50.796870 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:50.797019 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:50.801026 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:50.801031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:50.801034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:50.801068 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:50.803745 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:50.804635 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:50.804642 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:50.804650 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:50.804849 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:50.805344 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:50.805351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:50.805354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:50.805655 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:50.805828 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:50.806611 (+ 783us) server_negotiation.cc:299] Negotiation successful
0811 12:43:50.806866 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":261,"threads_started":1}
I20260811 12:43:50.808307 19138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:50.787592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:44187)
0811 12:43:50.788407 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:50.788450 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:50.790900 (+ 2450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:50.791902 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:50.791917 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:50.792697 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:50.793623 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:50.793651 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:50.794825 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:50.794829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:50.796227 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:50.796241 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:50.797126 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:50.797135 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:50.797389 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:50.798136 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:50.798166 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:50.800719 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:50.803946 (+ 3227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:50.803955 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:50.803973 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:50.804503 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:50.804977 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:50.804983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:50.804987 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:50.805194 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:50.805796 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:50.805806 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:50.806182 (+ 376us) client_negotiation.cc:769] Sending connection context
0811 12:43:50.806473 (+ 291us) client_negotiation.cc:240] Negotiation successful
0811 12:43:50.807075 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":303,"threads_started":1}
I20260811 12:43:50.810361 19135 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35823
I20260811 12:43:50.810668 19135 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:50.811623 19135 heartbeater.cc:511] Master 127.0.186.126:35823 requested a full tablet report, sending...
I20260811 12:43:50.814491 18920 ts_manager.cc:194] Registered new tserver with Master: 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65:39683)
I20260811 12:43:50.817021 18920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:44187
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:43:50.872850 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35823
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:43:51.249195 19144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:51.249504 19144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:51.249601 19144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:51.257395 19144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:51.257513 19144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:51.257632 19144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:43:51.267905 19144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:51.269325 19144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:51.270687 19144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:51.284909 19151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:51.284857 19153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:51.284963 19150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:51.290443 19144 server_base.cc:1034] running on GCE node
I20260811 12:43:51.291215 19144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:51.292337 19144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:51.293556 19144 hybrid_clock.cc:648] HybridClock initialized: now 1786452231293508 us; error 41 us; skew 500 ppm
I20260811 12:43:51.293910 19144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:51 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452231, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:51.297355 19144 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:43:51.299075 19144 webserver.cc:460] Webserver started at http://127.0.186.66:42675/ using document root <none> and password file <none>
I20260811 12:43:51.299796 19144 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:51.299926 19144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:51.300220 19144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:51.303349 19144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "07cd1cc52b494763922284c059b5e52f"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "b0dfd9b52cae6b7808c9c8c895325035"
server_key_iv: "ec30057931a61f1e0976b5ea194aafe1"
server_key_version: "encryptionkey@0"
I20260811 12:43:51.304164 19144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "07cd1cc52b494763922284c059b5e52f"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "b0dfd9b52cae6b7808c9c8c895325035"
server_key_iv: "ec30057931a61f1e0976b5ea194aafe1"
server_key_version: "encryptionkey@0"
I20260811 12:43:51.309857 19144 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 12:43:51.313809 19160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:51.315340 19144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:43:51.315536 19144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "07cd1cc52b494763922284c059b5e52f"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "b0dfd9b52cae6b7808c9c8c895325035"
server_key_iv: "ec30057931a61f1e0976b5ea194aafe1"
server_key_version: "encryptionkey@0"
I20260811 12:43:51.315758 19144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:51.337612 19144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:51.342574 19144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:51.342959 19144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:51.344089 19144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:51.346026 19144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:51.346114 19144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:51.346302 19144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:51.346362 19144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:51.384217 19144 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:41283
I20260811 12:43:51.384433 19297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:41283 every 8 connection(s)
I20260811 12:43:51.385648 19144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:43:51.389894 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 19144
I20260811 12:43:51.390126 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:43:51.390708 745 external_mini_cluster.cc:1428] Setting key 9af5f39f0684415222e3e2e2bf187a1f
Aug 11 12:43:51 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452231, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:51.409315 19300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:51.388647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:47337 (local address 127.0.186.126:35823)
0811 12:43:51.389289 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:51.389294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:51.390482 (+ 1188us) server_negotiation.cc:407] Connection header received
0811 12:43:51.392834 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:51.392840 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:51.392954 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:51.393095 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:51.394818 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.395684 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.397616 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.398113 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.398270 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:51.402388 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:51.402394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:51.402398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:51.402437 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:51.405668 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:51.406548 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:51.406559 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:51.406561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:51.406695 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:51.407219 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:51.407224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:51.407226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:51.407534 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:51.407714 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:51.408518 (+ 804us) server_negotiation.cc:299] Negotiation successful
0811 12:43:51.408819 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":336,"threads_started":1}
I20260811 12:43:51.410431 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:51.389286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:47337)
0811 12:43:51.390310 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:51.390354 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:51.392477 (+ 2123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:51.393377 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:51.393387 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:51.393980 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:51.394621 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:51.394641 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.395875 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.395879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:51.397440 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:51.397454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.398386 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.398395 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:51.398665 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:51.399469 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:51.399508 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:51.402073 (+ 2565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:51.405847 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:51.405858 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:51.405879 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:51.406390 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:51.406826 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:51.406832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:51.406837 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:51.407070 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:51.407684 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:51.407694 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:51.408106 (+ 412us) client_negotiation.cc:769] Sending connection context
0811 12:43:51.408408 (+ 302us) client_negotiation.cc:240] Negotiation successful
0811 12:43:51.409108 (+ 700us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":354,"threads_started":1}
I20260811 12:43:51.412446 19298 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35823
I20260811 12:43:51.412891 19298 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:51.413961 19298 heartbeater.cc:511] Master 127.0.186.126:35823 requested a full tablet report, sending...
I20260811 12:43:51.416019 18920 ts_manager.cc:194] Registered new tserver with Master: 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283)
I20260811 12:43:51.417552 18920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:47337
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:43:51.473716 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35823
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:43:51.820545 19135 heartbeater.cc:503] Master 127.0.186.126:35823 was elected leader, sending a full tablet report...
W20260811 12:43:51.849740 19304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:43:51.850090 19304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:43:51.850261 19304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:43:51.857921 19304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:43:51.858059 19304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:43:51.858289 19304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:43:51.868494 19304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:43:51.870121 19304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:43:51.871526 19304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:43:51.885543 19310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:51.885700 19312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:43:51.885618 19314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:43:51.887401 19304 server_base.cc:1034] running on GCE node
I20260811 12:43:51.888135 19304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:43:51.889355 19304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:43:51.890614 19304 hybrid_clock.cc:648] HybridClock initialized: now 1786452231890538 us; error 74 us; skew 500 ppm
I20260811 12:43:51.890960 19304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:43:51 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452231, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:43:51.894490 19304 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:43:51.896133 19304 webserver.cc:460] Webserver started at http://127.0.186.67:38185/ using document root <none> and password file <none>
I20260811 12:43:51.897015 19304 fs_manager.cc:359] Metadata directory not provided
I20260811 12:43:51.897177 19304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:43:51.897511 19304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:43:51.900820 19304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "43c501e3dcc14133b0a749a870ce5317"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "ffec3006199850dfe21eeb4d69165a12"
server_key_iv: "9be0cfed7441bd694b71493ee6f84a18"
server_key_version: "encryptionkey@0"
I20260811 12:43:51.901681 19304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "43c501e3dcc14133b0a749a870ce5317"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "ffec3006199850dfe21eeb4d69165a12"
server_key_iv: "9be0cfed7441bd694b71493ee6f84a18"
server_key_version: "encryptionkey@0"
I20260811 12:43:51.907231 19304 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:43:51.911092 19321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:51.912719 19304 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:43:51.912967 19304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "43c501e3dcc14133b0a749a870ce5317"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "ffec3006199850dfe21eeb4d69165a12"
server_key_iv: "9be0cfed7441bd694b71493ee6f84a18"
server_key_version: "encryptionkey@0"
I20260811 12:43:51.913249 19304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:43:51.928037 19304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:43:51.933466 19304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:43:51.933799 19304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:43:51.934846 19304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:43:51.936408 19304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:43:51.936487 19304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:51.936663 19304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:43:51.936717 19304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:43:51.970768 19304 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:39823
I20260811 12:43:51.970827 19454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:39823 every 8 connection(s)
I20260811 12:43:51.972240 19304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:43:51.981842 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 19304
I20260811 12:43:51.982057 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:43:51.982537 745 external_mini_cluster.cc:1428] Setting key d5c61a2c33b27af5c834c167433c7038
Aug 11 12:43:51 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452231, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:43:51.993633 19457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:51.974965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:51091 (local address 127.0.186.126:35823)
0811 12:43:51.975540 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:51.975545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:51.976296 (+ 751us) server_negotiation.cc:407] Connection header received
0811 12:43:51.978293 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:51.978299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:51.978398 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:51.978532 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:51.980134 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.981039 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.982770 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.983204 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.983358 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:51.987794 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:51.987799 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:51.987802 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:51.987838 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:51.990529 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:51.991316 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:51.991319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:51.991322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:51.991445 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:51.991894 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:51.991898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:51.991900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:51.992199 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:51.992324 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:51.993148 (+ 824us) server_negotiation.cc:299] Negotiation successful
0811 12:43:51.993329 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":278,"threads_started":1}
I20260811 12:43:51.994675 19458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:51.975392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:51091)
0811 12:43:51.976128 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:51.976167 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:51.977989 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:51.978810 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:51.978819 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:51.979364 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:43:51.979942 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:51.979959 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.981200 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.981206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:51.982606 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:51.982625 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:51.983455 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:51.983460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:51.983812 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:51.984771 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:43:51.984808 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:43:51.987571 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:43:51.990698 (+ 3127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:51.990706 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:51.990720 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:51.991194 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:51.991578 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:43:51.991582 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:43:51.991584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:43:51.991783 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:43:51.992331 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:43:51.992337 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:43:51.992689 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 12:43:51.993037 (+ 348us) client_negotiation.cc:240] Negotiation successful
0811 12:43:51.993457 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":305,"threads_started":1}
I20260811 12:43:51.996219 19455 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35823
I20260811 12:43:51.996557 19455 heartbeater.cc:464] Registering TS with master...
I20260811 12:43:51.997574 19455 heartbeater.cc:511] Master 127.0.186.126:35823 requested a full tablet report, sending...
I20260811 12:43:51.999243 18920 ts_manager.cc:194] Registered new tserver with Master: 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67:39823)
I20260811 12:43:52.000114 18920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:51091
I20260811 12:43:52.011731 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:43:52.030676 19457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.016838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47614 (local address 127.0.186.126:35823)
0811 12:43:52.017056 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.017070 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.017644 (+ 574us) server_negotiation.cc:407] Connection header received
0811 12:43:52.017790 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.017794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.017901 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.018023 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:52.019583 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.020428 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.021992 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.022396 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.022505 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.025212 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:52.025216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:52.025219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:52.025256 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:52.028036 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.028833 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.028837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.028840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.028986 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.029346 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.029349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.029351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.029684 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:52.029879 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.030186 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.030370 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 12:43:52.035320 18920 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:43:52.042532 18920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:43:52.077831 19470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.055986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:41283 (local address 127.0.0.1:53870)
0811 12:43:52.056786 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:52.056840 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:52.057066 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:52.066786 (+ 9720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:52.066798 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:52.066855 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:52.067458 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.067475 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.070464 (+ 2989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.070473 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.073800 (+ 3327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.073827 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.076389 (+ 2562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.076398 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.076800 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.076889 (+ 89us) client_negotiation.cc:769] Sending connection context
0811 12:43:52.077122 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 12:43:52.077351 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":9594,"threads_started":1}
I20260811 12:43:52.079396 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.056573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.0.186.66:41283)
0811 12:43:52.065888 (+ 9315us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.065901 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.065945 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:43:52.066077 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.066089 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.066427 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.067750 (+ 1323us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:52.068056 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.070245 (+ 2189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.074103 (+ 3858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.076130 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.078540 (+ 2410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.078805 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.078884 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.079066 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9118,"thread_start_us":8986,"threads_started":1}
I20260811 12:43:52.083586 19219 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb6921068c942628c4ff8ed763b67d7 (DEFAULT_TABLE table=test-table [id=a9b7016b18d94127b182452bfb15e68b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:52.085727 19219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb6921068c942628c4ff8ed763b67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:52.088709 19474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.066007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:39683 (local address 127.0.0.1:56550)
0811 12:43:52.076115 (+ 10108us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:52.076139 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:52.076285 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:52.080672 (+ 4387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:52.080677 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:52.080711 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:52.081149 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.081166 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.083177 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.083183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.085544 (+ 2361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.085563 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.087860 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.087866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.088055 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.088096 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 12:43:52.088180 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 12:43:52.088331 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9940,"thread_start_us":11131,"threads_started":1}
I20260811 12:43:52.089753 19476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.066763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.0.186.65:39683)
0811 12:43:52.078965 (+ 12202us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.078975 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.079014 (+ 39us) server_negotiation.cc:407] Connection header received
0811 12:43:52.079118 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.079126 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.079425 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.080687 (+ 1262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:52.081399 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.082983 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.085738 (+ 2755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.087301 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.087450 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.087687 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.089194 (+ 1507us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.089371 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12013,"thread_start_us":11841,"threads_started":1}
I20260811 12:43:52.090493 19471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.056347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:39823 (local address 127.0.0.1:56190)
0811 12:43:52.065299 (+ 8952us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:52.065325 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:52.065479 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:52.082741 (+ 17262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:52.082746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:52.082773 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:52.083302 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.083318 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.085659 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.085666 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.087865 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.087878 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.089864 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.089873 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.090057 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.090083 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 12:43:52.090141 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 12:43:52.090237 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8799,"thread_start_us":8643,"threads_started":1}
I20260811 12:43:52.091400 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.065128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56190 (local address 127.0.186.67:39823)
0811 12:43:52.082132 (+ 17004us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.082140 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.082174 (+ 34us) server_negotiation.cc:407] Connection header received
0811 12:43:52.082262 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.082280 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.082518 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.083531 (+ 1013us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:52.083834 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.085474 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.088097 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.089595 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.090785 (+ 1190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.090968 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.091031 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.091158 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16805,"thread_start_us":13007,"threads_started":1}
I20260811 12:43:52.095667 19378 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb6921068c942628c4ff8ed763b67d7 (DEFAULT_TABLE table=test-table [id=a9b7016b18d94127b182452bfb15e68b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:52.095667 19061 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb6921068c942628c4ff8ed763b67d7 (DEFAULT_TABLE table=test-table [id=a9b7016b18d94127b182452bfb15e68b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:43:52.097349 19061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb6921068c942628c4ff8ed763b67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:52.097347 19378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb6921068c942628c4ff8ed763b67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:43:52.100153 19478 tablet_bootstrap.cc:492] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Bootstrap starting.
I20260811 12:43:52.103585 19478 tablet_bootstrap.cc:654] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:52.105100 19478 log.cc:824] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:52.113782 19480 tablet_bootstrap.cc:492] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Bootstrap starting.
I20260811 12:43:52.114383 19481 tablet_bootstrap.cc:492] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Bootstrap starting.
I20260811 12:43:52.115418 19478 tablet_bootstrap.cc:492] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: No bootstrap required, opened a new log
I20260811 12:43:52.115764 19478 ts_tablet_manager.cc:1397] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20260811 12:43:52.117875 19480 tablet_bootstrap.cc:654] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:52.117915 19481 tablet_bootstrap.cc:654] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Neither blocks nor log segments found. Creating new log.
I20260811 12:43:52.119151 19481 log.cc:824] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:52.119241 19480 log.cc:824] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Log is configured to *not* fsync() on all Append() calls
I20260811 12:43:52.122907 19481 tablet_bootstrap.cc:492] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: No bootstrap required, opened a new log
I20260811 12:43:52.123238 19481 ts_tablet_manager.cc:1397] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 12:43:52.124440 19480 tablet_bootstrap.cc:492] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: No bootstrap required, opened a new log
I20260811 12:43:52.124804 19480 ts_tablet_manager.cc:1397] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 12:43:52.127378 19478 raft_consensus.cc:348] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.127918 19478 raft_consensus.cc:374] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:52.128023 19478 raft_consensus.cc:729] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07cd1cc52b494763922284c059b5e52f, State: Initialized, Role: FOLLOWER
I20260811 12:43:52.128763 19478 consensus_queue.cc:260] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.131709 19298 heartbeater.cc:503] Master 127.0.186.126:35823 was elected leader, sending a full tablet report...
I20260811 12:43:52.132486 19478 ts_tablet_manager.cc:1428] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260811 12:43:52.132265 19481 raft_consensus.cc:348] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.132752 19481 raft_consensus.cc:374] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:43:52.132855 19481 raft_consensus.cc:729] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c501e3dcc14133b0a749a870ce5317, State: Initialized, Role: FOLLOWER
I20260811 12:43:52.133675 19481 consensus_queue.cc:260] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.134884 19455 heartbeater.cc:503] Master 127.0.186.126:35823 was elected leader, sending a full tablet report...
I20260811 12:43:52.135623 19481 ts_tablet_manager.cc:1428] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Time spent starting tablet: real 0.012s user 0.008s sys 0.005s
I20260811 12:43:52.137272 19480 raft_consensus.cc:348] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.137776 19480 raft_consensus.cc:374] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 12:43:52.137837 19299 tablet.cc:2369] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:43:52.137898 19480 raft_consensus.cc:729] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b7fb00fdf1042189b861e3645dd7c04, State: Initialized, Role: FOLLOWER
I20260811 12:43:52.138604 19480 consensus_queue.cc:260] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.140347 19480 ts_tablet_manager.cc:1428] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
I20260811 12:43:52.147148 19487 raft_consensus.cc:482] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:43:52.147466 19487 raft_consensus.cc:504] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.149293 19487 leader_election.cc:288] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283), 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65:39683)
I20260811 12:43:52.156088 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.149679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:46063 (local address 127.0.186.66:41283)
0811 12:43:52.149872 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.149877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.149897 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:43:52.150074 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.150080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.150176 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.150278 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:52.150892 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.151970 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.153980 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.155213 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.155340 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.155396 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.155785 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.155883 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:43:52.156210 19458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.149595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:41283 (local address 127.0.186.67:46063)
0811 12:43:52.149804 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:52.149825 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:52.149945 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:52.150473 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:52.150477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:52.150506 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:52.150682 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.150690 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.152115 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.152122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.153797 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.153814 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.155376 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.155382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.155605 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.155643 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 12:43:52.155755 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 12:43:52.155905 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 12:43:52.157226 19476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.150273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:43695 (local address 127.0.186.65:39683)
0811 12:43:52.150491 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.150498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.150790 (+ 292us) server_negotiation.cc:407] Connection header received
0811 12:43:52.150991 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.150995 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.151054 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.151123 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:43:52.151743 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.152808 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.154972 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.156137 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.156312 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.156386 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.156864 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.156996 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 12:43:52.157335 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.149995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:39683 (local address 127.0.186.67:43695)
0811 12:43:52.150678 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 12:43:52.150697 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:43:52.150849 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:43:52.151173 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:43:52.151178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:43:52.151207 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:43:52.151597 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.151609 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.152964 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.152968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.154797 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:43:52.154815 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.156511 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.156517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:43:52.156675 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.156696 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 12:43:52.156835 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 12:43:52.156968 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":505,"threads_started":1}
I20260811 12:43:52.157378 19244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6921068c942628c4ff8ed763b67d7" candidate_uuid: "43c501e3dcc14133b0a749a870ce5317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07cd1cc52b494763922284c059b5e52f" is_pre_election: true
I20260811 12:43:52.158025 19244 raft_consensus.cc:2454] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c501e3dcc14133b0a749a870ce5317 in term 0.
I20260811 12:43:52.158496 19085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6921068c942628c4ff8ed763b67d7" candidate_uuid: "43c501e3dcc14133b0a749a870ce5317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b7fb00fdf1042189b861e3645dd7c04" is_pre_election: true
I20260811 12:43:52.158831 19323 leader_election.cc:302] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07cd1cc52b494763922284c059b5e52f, 43c501e3dcc14133b0a749a870ce5317; no voters:
I20260811 12:43:52.159058 19085 raft_consensus.cc:2454] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c501e3dcc14133b0a749a870ce5317 in term 0.
I20260811 12:43:52.159278 19487 raft_consensus.cc:2781] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:43:52.159425 19487 raft_consensus.cc:482] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:43:52.159562 19487 raft_consensus.cc:3037] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:52.162194 19487 raft_consensus.cc:504] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.163092 19487 leader_election.cc:288] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [CANDIDATE]: Term 1 election: Requested vote from peers 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283), 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65:39683)
I20260811 12:43:52.163606 19244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6921068c942628c4ff8ed763b67d7" candidate_uuid: "43c501e3dcc14133b0a749a870ce5317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07cd1cc52b494763922284c059b5e52f"
I20260811 12:43:52.163667 19085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6921068c942628c4ff8ed763b67d7" candidate_uuid: "43c501e3dcc14133b0a749a870ce5317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b7fb00fdf1042189b861e3645dd7c04"
I20260811 12:43:52.163859 19244 raft_consensus.cc:3037] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:52.163899 19085 raft_consensus.cc:3037] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:43:52.166289 19085 raft_consensus.cc:2454] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c501e3dcc14133b0a749a870ce5317 in term 1.
I20260811 12:43:52.166291 19244 raft_consensus.cc:2454] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c501e3dcc14133b0a749a870ce5317 in term 1.
I20260811 12:43:52.166738 19323 leader_election.cc:302] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b7fb00fdf1042189b861e3645dd7c04, 43c501e3dcc14133b0a749a870ce5317; no voters:
I20260811 12:43:52.167058 19487 raft_consensus.cc:2781] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:43:52.167534 19487 raft_consensus.cc:686] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 1 LEADER]: Becoming Leader. State: Replica: 43c501e3dcc14133b0a749a870ce5317, State: Running, Role: LEADER
I20260811 12:43:52.168033 19487 consensus_queue.cc:237] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } }
I20260811 12:43:52.173264 18920 catalog_manager.cc:5495] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67). New cstate: current_term: 1 leader_uuid: "43c501e3dcc14133b0a749a870ce5317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } health_report { overall_health: UNKNOWN } } }
I20260811 12:43:52.195341 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.189875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56192 (local address 127.0.186.67:39823)
0811 12:43:52.190109 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.190113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.190133 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:43:52.190269 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.190273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.190364 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.190489 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:43:52.190868 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.191635 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.193154 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.193554 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.193650 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.194143 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:43:52.194677 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:43:52.194788 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.194920 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.194994 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 12:43:52.204114 19244 raft_consensus.cc:1261] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Refusing update from remote peer 43c501e3dcc14133b0a749a870ce5317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:52.204244 19085 raft_consensus.cc:1261] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Refusing update from remote peer 43c501e3dcc14133b0a749a870ce5317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:43:52.205317 19490 consensus_queue.cc:1035] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:52.205765 19487 consensus_queue.cc:1035] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:43:52.215622 19493 mvcc.cc:205] Tried to move back new op lower bound from 7317308343097143296 to 7317308342964469760. Current Snapshot: MvccSnapshot[applied={T|T < 7317308343097143296}]
I20260811 12:43:52.233335 18919 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:52.233675 18919 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:43:52.237949 18919 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Sending DeleteTablet for 3 replicas of tablet 0bb6921068c942628c4ff8ed763b67d7
I20260811 12:43:52.239563 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 18987
I20260811 12:43:52.239550 19219 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bb6921068c942628c4ff8ed763b67d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:52 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:53870
I20260811 12:43:52.239714 19061 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bb6921068c942628c4ff8ed763b67d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:52 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:56550
I20260811 12:43:52.240411 19378 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bb6921068c942628c4ff8ed763b67d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:43:52 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:56190
I20260811 12:43:52.240623 19504 tablet_replica.cc:330] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: stopping tablet replica
I20260811 12:43:52.241160 19504 raft_consensus.cc:2229] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:52.241837 19504 raft_consensus.cc:2258] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:52.244717 19504 ts_tablet_manager.cc:1905] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:52.252820 19507 tablet_replica.cc:330] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: stopping tablet replica
I20260811 12:43:52.253326 19507 raft_consensus.cc:2229] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:43:52.254052 19504 ts_tablet_manager.cc:1918] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:52.254133 19507 raft_consensus.cc:2258] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:52.254264 19504 log.cc:1196] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/0bb6921068c942628c4ff8ed763b67d7
I20260811 12:43:52.254904 19504 ts_tablet_manager.cc:1939] T 0bb6921068c942628c4ff8ed763b67d7 P 07cd1cc52b494763922284c059b5e52f: Deleting consensus metadata
I20260811 12:43:52.256508 19507 ts_tablet_manager.cc:1905] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:52.257011 18904 catalog_manager.cc:4841] TS 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283): tablet 0bb6921068c942628c4ff8ed763b67d7 (table test-table [id=a9b7016b18d94127b182452bfb15e68b]) successfully deleted
I20260811 12:43:52.262246 19505 tablet_replica.cc:330] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: stopping tablet replica
I20260811 12:43:52.262894 19505 raft_consensus.cc:2229] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:43:52.262939 19507 ts_tablet_manager.cc:1918] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:52.263139 19507 log.cc:1196] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/0bb6921068c942628c4ff8ed763b67d7
I20260811 12:43:52.263787 19507 ts_tablet_manager.cc:1939] T 0bb6921068c942628c4ff8ed763b67d7 P 43c501e3dcc14133b0a749a870ce5317: Deleting consensus metadata
I20260811 12:43:52.263765 19505 raft_consensus.cc:2258] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:43:52.265924 18906 catalog_manager.cc:4841] TS 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67:39823): tablet 0bb6921068c942628c4ff8ed763b67d7 (table test-table [id=a9b7016b18d94127b182452bfb15e68b]) successfully deleted
I20260811 12:43:52.266619 19505 ts_tablet_manager.cc:1905] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:43:52.272423 19505 ts_tablet_manager.cc:1918] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:43:52.272655 19505 log.cc:1196] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/0bb6921068c942628c4ff8ed763b67d7
I20260811 12:43:52.273202 19505 ts_tablet_manager.cc:1939] T 0bb6921068c942628c4ff8ed763b67d7 P 2b7fb00fdf1042189b861e3645dd7c04: Deleting consensus metadata
Aug 11 12:43:52 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:43:52.275504 18904 catalog_manager.cc:4841] TS 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65:39683): tablet 0bb6921068c942628c4ff8ed763b67d7 (table test-table [id=a9b7016b18d94127b182452bfb15e68b]) successfully deleted
I20260811 12:43:52.282745 19476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.241005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56552 (local address 127.0.186.65:39683)
0811 12:43:52.241204 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.241211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.261482 (+ 20271us) server_negotiation.cc:407] Connection header received
0811 12:43:52.261718 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.261724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.261854 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.261982 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:52.264452 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.265802 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.268186 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.268952 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.269096 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.275451 (+ 6355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:52.275466 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:52.275486 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:52.275550 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:52.279207 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.280219 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.280230 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.280233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.280413 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.280936 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.280940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.280942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.281331 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:52.281555 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.282112 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.282357 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:43:52.283532 19130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:52.377848 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 18987
I20260811 12:43:52.407810 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 19144
Aug 11 12:43:52 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:43:52.427681 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.408790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53884 (local address 127.0.186.66:41283)
0811 12:43:52.409034 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.409041 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.409063 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:43:52.409134 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.409140 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.409221 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.409347 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:52.410697 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.411882 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.413755 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.414452 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.414614 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.419641 (+ 5027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:52.419662 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:52.419683 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:52.419737 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:52.423978 (+ 4241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.424892 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.424904 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.424908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.425165 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.425611 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.425616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.425620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.426184 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:52.426517 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.426811 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.427084 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 12:43:52.428537 19292 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:52.523175 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 19144
I20260811 12:43:52.549054 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 19304
Aug 11 12:43:52 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:43:52.567281 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:43:52.550026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56200 (local address 127.0.186.67:39823)
0811 12:43:52.550251 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 12:43:52.550261 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:43:52.550286 (+ 25us) server_negotiation.cc:407] Connection header received
0811 12:43:52.550364 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:43:52.550377 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:43:52.550463 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:43:52.550594 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:43:52.551956 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.552893 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.554296 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:43:52.554784 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:43:52.554927 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:43:52.560197 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:43:52.560216 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:43:52.560232 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:43:52.560276 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:43:52.563548 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.564325 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.564336 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.564341 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.564520 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:43:52.565041 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:43:52.565046 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:43:52.565050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:43:52.565486 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:43:52.565868 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0811 12:43:52.566211 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 12:43:52.566454 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 12:43:52.568181 19449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:52.699682 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 19304
I20260811 12:43:52.728127 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 18884
I20260811 12:43:52.729516 18953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:43:52.848970 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 18884
I20260811 12:44:12.877823 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35823
--webserver_interface=127.0.186.126
--webserver_port=32909
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:44:13.257899 19513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:13.258247 19513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:13.258421 19513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:13.266175 19513 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 12:44:13.266297 19513 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 12:44:13.266373 19513 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 12:44:13.266472 19513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:44:13.266559 19513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:13.266702 19513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:13.266795 19513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:44:13.266880 19513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:44:13.277529 19513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=32909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:13.279068 19513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:13.280601 19513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:13.309429 19523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:13.309508 19521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:13.309461 19520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:13.310438 19513 server_base.cc:1034] running on GCE node
I20260811 12:44:13.311560 19513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:13.313421 19513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:13.314693 19513 hybrid_clock.cc:648] HybridClock initialized: now 1786452253314619 us; error 46 us; skew 500 ppm
I20260811 12:44:13.315243 19513 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:13 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452253, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:13.325462 19513 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:44:13.327499 19513 webserver.cc:460] Webserver started at http://127.0.186.126:32909/ using document root <none> and password file <none>
I20260811 12:44:13.328341 19513 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:13.328454 19513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:13.335332 19513 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 12:44:13.338955 19531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:13.340634 19513 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260811 12:44:13.340883 19513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "2a2e6da5293a4f7b9712bca52d219bbf"
format_stamp: "Formatted at 2026-08-11 12:43:49 on dist-test-slave-qg60"
server_key: "132f030bc57851a7de1320641ba43d66"
server_key_iv: "377dde5e3b8bb6b720ba3dba5ada9b79"
server_key_version: "encryptionkey@0"
I20260811 12:44:13.342087 19513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:13.364288 19513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:13.369517 19513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:13.369805 19513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:13.391635 19513 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35823
I20260811 12:44:13.391644 19591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35823 every 8 connection(s)
I20260811 12:44:13.393553 19513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:44:13.401284 19592 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:44:13.403623 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 19513
I20260811 12:44:13.404759 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:39683
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:35823
--webserver_port=40889
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:44:13.405905 19592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap starting.
I20260811 12:44:13.434645 19592 log.cc:824] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:13.449962 19592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:44:13.450634 19592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap complete.
I20260811 12:44:13.463718 19592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:13.464840 19592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a2e6da5293a4f7b9712bca52d219bbf, State: Initialized, Role: FOLLOWER
I20260811 12:44:13.465701 19592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:13.466037 19592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:44:13.466197 19592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:44:13.466437 19592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 1 FOLLOWER]: Advancing to term 2
I20260811 12:44:13.471675 19592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:13.472378 19592 leader_election.cc:302] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a2e6da5293a4f7b9712bca52d219bbf; no voters:
I20260811 12:44:13.473243 19592 leader_election.cc:288] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 12:44:13.473407 19598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Leader election won for term 2
I20260811 12:44:13.474898 19598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 LEADER]: Becoming Leader. State: Replica: 2a2e6da5293a4f7b9712bca52d219bbf, State: Running, Role: LEADER
I20260811 12:44:13.475584 19598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:13.476053 19592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:44:13.478645 19600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a2e6da5293a4f7b9712bca52d219bbf. Latest consensus state: current_term: 2 leader_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } } }
I20260811 12:44:13.479100 19600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:13.478871 19599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } } }
I20260811 12:44:13.479384 19599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:13.481882 19604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:44:13.503958 19604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:44:13.506050 19604 catalog_manager.cc:1259] Loaded cluster ID: 70dc876803a642a9a0d482874edbc5df
I20260811 12:44:13.506196 19604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:44:13.510905 19604 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:44:13.512933 19604 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Loaded TSK: 0
I20260811 12:44:13.555770 19604 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Generated new TSK 1
I20260811 12:44:13.556280 19604 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 12:44:13.828104 19595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:13.828465 19595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:13.828644 19595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:13.836476 19595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:13.836638 19595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:13.836865 19595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:44:13.847646 19595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:39683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=40889
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:13.849255 19595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:13.850690 19595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:13.868461 19624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:13.868515 19626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:13.869263 19623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:13.874893 19595 server_base.cc:1034] running on GCE node
I20260811 12:44:13.875689 19595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:13.876883 19595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:13.878157 19595 hybrid_clock.cc:648] HybridClock initialized: now 1786452253878094 us; error 55 us; skew 500 ppm
I20260811 12:44:13.878509 19595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:13 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452253, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:13.882144 19595 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:44:13.883955 19595 webserver.cc:460] Webserver started at http://127.0.186.65:40889/ using document root <none> and password file <none>
I20260811 12:44:13.884783 19595 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:13.884960 19595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:13.890985 19595 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 12:44:13.894093 19634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:13.895604 19595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 12:44:13.895773 19595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "2b7fb00fdf1042189b861e3645dd7c04"
format_stamp: "Formatted at 2026-08-11 12:43:50 on dist-test-slave-qg60"
server_key: "c5c15dc6a5ffb7aba705fb5d10a79566"
server_key_iv: "7e102c750b6f4a249681fa5b084c96c4"
server_key_version: "encryptionkey@0"
I20260811 12:44:13.896891 19595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:13.927502 19595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:13.932416 19595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:13.932772 19595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:13.933893 19595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:13.935379 19595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:13.935508 19595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:13.935650 19595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:13.935745 19595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:13.973343 19595 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:39683
I20260811 12:44:13.973441 19759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:39683 every 8 connection(s)
I20260811 12:44:13.974896 19595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:44:13.979389 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 19595
I20260811 12:44:13.980181 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:41283
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:35823
--webserver_port=42675
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:44:13 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452253, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:14.001590 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:13.978188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:34957 (local address 127.0.186.126:35823)
0811 12:44:13.978775 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:13.978788 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:13.979495 (+ 707us) server_negotiation.cc:407] Connection header received
0811 12:44:13.981983 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:13.981995 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:13.982338 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:13.982712 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:13.984352 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:13.985718 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:13.987341 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:13.987989 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:13.988201 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:13.992437 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:13.992451 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:13.992475 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:13.992546 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:13.996010 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:13.997129 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:13.997137 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:13.997142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:13.997313 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:13.997884 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:13.997888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:13.997891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:13.998499 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:13.998728 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:13.999745 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0811 12:44:14.000250 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":267,"threads_started":1}
I20260811 12:44:14.001715 19763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:13.978455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:34957)
0811 12:44:13.979304 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:13.979343 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:13.981410 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:13.982869 (+ 1459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:13.982879 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:13.983557 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:13.984126 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:13.984145 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:13.985908 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:13.985913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:13.987177 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:13.987203 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:13.988254 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:13.988261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:13.988541 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:13.989324 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:44:13.989349 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:13.992042 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:13.996197 (+ 4155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:13.996210 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:13.996230 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:13.996966 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:13.997440 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:13.997447 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:13.997453 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:13.997724 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:13.998687 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:13.998699 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:13.999164 (+ 465us) client_negotiation.cc:769] Sending connection context
0811 12:44:13.999530 (+ 366us) client_negotiation.cc:240] Negotiation successful
0811 12:44:14.000224 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":379,"threads_started":1}
I20260811 12:44:14.005226 19760 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35823
I20260811 12:44:14.005631 19760 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:14.006461 19760 heartbeater.cc:511] Master 127.0.186.126:35823 requested a full tablet report, sending...
I20260811 12:44:14.009377 19552 ts_manager.cc:194] Registered new tserver with Master: 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65:39683)
I20260811 12:44:14.011842 19552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:34957
W20260811 12:44:14.352077 19764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:14.352368 19764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:14.352471 19764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:14.359835 19764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:14.359948 19764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:14.360071 19764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:44:14.370291 19764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:41283
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=42675
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:14.371644 19764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:14.373104 19764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:14.387148 19772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:14.387172 19769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:14.387182 19770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:14.388204 19764 server_base.cc:1034] running on GCE node
I20260811 12:44:14.389001 19764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:14.390143 19764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:14.391381 19764 hybrid_clock.cc:648] HybridClock initialized: now 1786452254391279 us; error 87 us; skew 500 ppm
I20260811 12:44:14.391779 19764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:14 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452254, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:14.395494 19764 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:44:14.398018 19764 webserver.cc:460] Webserver started at http://127.0.186.66:42675/ using document root <none> and password file <none>
I20260811 12:44:14.398783 19764 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:14.398977 19764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:14.405836 19764 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:44:14.408985 19779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:14.410449 19764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:44:14.410666 19764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "07cd1cc52b494763922284c059b5e52f"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "b0dfd9b52cae6b7808c9c8c895325035"
server_key_iv: "ec30057931a61f1e0976b5ea194aafe1"
server_key_version: "encryptionkey@0"
I20260811 12:44:14.411753 19764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:14.433692 19764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:14.438359 19764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:14.438665 19764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:14.439814 19764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:14.441308 19764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:14.441434 19764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:14.441578 19764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:14.441671 19764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:14.479071 19764 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:41283
I20260811 12:44:14.479179 19911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:41283 every 8 connection(s)
I20260811 12:44:14.480721 19764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:44:14.491258 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 19764
I20260811 12:44:14.492074 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:39823
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:35823
--webserver_port=38185
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 12:44:14 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452254, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:14.504537 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:14.483646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:42251 (local address 127.0.186.126:35823)
0811 12:44:14.483884 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:14.483890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:14.485169 (+ 1279us) server_negotiation.cc:407] Connection header received
0811 12:44:14.487110 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:14.487115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:14.487237 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:14.487335 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:14.489199 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:14.490110 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:14.492567 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:14.493215 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:14.493367 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:14.497592 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:14.497598 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:14.497601 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:14.497641 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:14.500836 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:14.501838 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:14.501844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:14.501848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:14.502007 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:14.502499 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:14.502511 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:14.502513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:14.502863 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:14.503065 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:14.503855 (+ 790us) server_negotiation.cc:299] Negotiation successful
0811 12:44:14.504144 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 12:44:14.505699 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:14.484135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:42251)
0811 12:44:14.484996 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:14.485040 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:14.486795 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:14.487651 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:14.487660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:14.488242 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:14.489006 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:14.489027 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:14.490281 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:14.490285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:14.492354 (+ 2069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:14.492376 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:14.493549 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:14.493566 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:14.493791 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:14.494587 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:44:14.494618 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:14.497296 (+ 2678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:14.501013 (+ 3717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:14.501024 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:14.501045 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:14.501675 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:14.502137 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:14.502143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:14.502146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:14.502363 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:14.503008 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:14.503017 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:14.503449 (+ 432us) client_negotiation.cc:769] Sending connection context
0811 12:44:14.503757 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 12:44:14.504356 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":317,"threads_started":1}
I20260811 12:44:14.507880 19912 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35823
I20260811 12:44:14.508247 19912 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:14.509333 19912 heartbeater.cc:511] Master 127.0.186.126:35823 requested a full tablet report, sending...
I20260811 12:44:14.511344 19552 ts_manager.cc:194] Registered new tserver with Master: 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283)
I20260811 12:44:14.512274 19552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:42251
W20260811 12:44:14.863667 19916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:14.864115 19916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:14.864284 19916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:14.871793 19916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:14.871973 19916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:14.872154 19916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:44:14.882699 19916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:39823
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=38185
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:14.884151 19916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:14.885684 19916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:14.899989 19922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:14.900189 19924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:14.899950 19921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:14.901131 19916 server_base.cc:1034] running on GCE node
I20260811 12:44:14.901772 19916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:14.902772 19916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:14.903981 19916 hybrid_clock.cc:648] HybridClock initialized: now 1786452254903933 us; error 38 us; skew 500 ppm
I20260811 12:44:14.904326 19916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:14 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452254, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:14.908272 19916 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:44:14.909847 19916 webserver.cc:460] Webserver started at http://127.0.186.67:38185/ using document root <none> and password file <none>
I20260811 12:44:14.910584 19916 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:14.910746 19916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:14.916602 19916 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 12:44:14.919579 19931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:14.921118 19916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:44:14.921252 19916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "43c501e3dcc14133b0a749a870ce5317"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "ffec3006199850dfe21eeb4d69165a12"
server_key_iv: "9be0cfed7441bd694b71493ee6f84a18"
server_key_version: "encryptionkey@0"
I20260811 12:44:14.922223 19916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:14.936123 19916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:14.942719 19916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:14.943080 19916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:14.944473 19916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:14.946795 19916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:14.946923 19916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:14.947088 19916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:14.947178 19916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:14.997627 19916 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:39823
I20260811 12:44:14.997684 20053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:39823 every 8 connection(s)
I20260811 12:44:14.999295 19916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:44:15.002842 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 19916
I20260811 12:44:15.016369 19760 heartbeater.cc:503] Master 127.0.186.126:35823 was elected leader, sending a full tablet report...
Aug 11 12:44:15 dist-test-slave-qg60 krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452254, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:15.024087 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.004039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50916 (local address 127.0.186.126:35823)
0811 12:44:15.006000 (+ 1961us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.006004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.006019 (+ 15us) server_negotiation.cc:407] Connection header received
0811 12:44:15.006074 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.006078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.006138 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.006262 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:15.008853 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.009771 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.011636 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.012105 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.012201 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.016562 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:15.016568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:15.016573 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:15.016614 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:15.020489 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.021735 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.021739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.021741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.021861 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.022394 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.022414 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.022416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.022737 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:15.023045 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.023416 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.023660 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1870,"thread_start_us":1750,"threads_started":1}
I20260811 12:44:15.026502 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.002447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:57671 (local address 127.0.186.126:35823)
0811 12:44:15.003104 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.003109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.004393 (+ 1284us) server_negotiation.cc:407] Connection header received
0811 12:44:15.007180 (+ 2787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.007184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.007240 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.007319 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:15.009547 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.010411 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.012803 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.013288 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.013380 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.018643 (+ 5263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:15.018650 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:15.018656 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:15.018713 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:15.022640 (+ 3927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.023477 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.023483 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.023487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.023628 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.024219 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.024224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.024228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.024568 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:15.024776 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.025864 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.026169 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378}
I20260811 12:44:15.027731 20056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.003091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:57671)
0811 12:44:15.004152 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:15.004220 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:15.006781 (+ 2561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:15.007684 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:15.007701 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:15.008583 (+ 882us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:15.009368 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.009387 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.010597 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.010603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.012587 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.012603 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.013585 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.013594 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.013964 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.014811 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:44:15.014869 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:15.018363 (+ 3494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:15.022798 (+ 4435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:15.022810 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:15.022829 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:15.023328 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:15.023751 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:15.023760 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:15.023763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:15.024073 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:15.024721 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:15.024784 (+ 63us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:15.025306 (+ 522us) client_negotiation.cc:769] Sending connection context
0811 12:44:15.025653 (+ 347us) client_negotiation.cc:240] Negotiation successful
0811 12:44:15.026273 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":408,"threads_started":1}
I20260811 12:44:15.029235 20054 heartbeater.cc:347] Connected to a master server at 127.0.186.126:35823
I20260811 12:44:15.029605 20054 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:15.030450 20054 heartbeater.cc:511] Master 127.0.186.126:35823 requested a full tablet report, sending...
I20260811 12:44:15.031992 19552 ts_manager.cc:194] Registered new tserver with Master: 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67:39823)
I20260811 12:44:15.032994 19552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:57671
I20260811 12:44:15.040256 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:44:15.049248 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.041506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50918 (local address 127.0.186.126:35823)
0811 12:44:15.041719 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.041724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.042333 (+ 609us) server_negotiation.cc:407] Connection header received
0811 12:44:15.042526 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.042530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.042685 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.042825 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:44:15.043368 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.044168 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.045944 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.046403 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.046568 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.047075 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:44:15.048632 (+ 1557us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 12:44:15.049033 (+ 401us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50918: token expired
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 12:44:15.049400 19762 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50918: token expired
W20260811 12:44:15.050108 19460 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.186.126:35823)
I20260811 12:44:15.064805 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.050747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.0.186.126:35823)
0811 12:44:15.050899 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.050903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.050922 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:44:15.051082 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.051086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.051161 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.051242 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:15.052967 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.053705 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.055325 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.055715 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.055809 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.059028 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:15.059032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:15.059036 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:15.059070 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:15.062007 (+ 2937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.062714 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.062717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.062720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.062842 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.063345 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.063348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.063350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.063697 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:15.063884 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.064275 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.064465 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 12:44:15.068784 19552 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:44:15.077235 19552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:44:15.102229 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.091714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52160 (local address 127.0.186.67:39823)
0811 12:44:15.092636 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.092649 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.092684 (+ 35us) server_negotiation.cc:407] Connection header received
0811 12:44:15.092955 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.092964 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.093242 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.093474 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:15.094596 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.096287 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.099253 (+ 2966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.100855 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.100990 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.101316 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.101635 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.101803 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":533,"threads_started":1}
I20260811 12:44:15.102224 20066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.090955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:39823 (local address 127.0.0.1:52160)
0811 12:44:15.092592 (+ 1637us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:15.092619 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:15.092771 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:15.093844 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:15.093852 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:15.093883 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:15.094355 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.094370 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.096496 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.096503 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.099005 (+ 2502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.099016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.101092 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.101100 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.101303 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.101369 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 12:44:15.101537 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 12:44:15.101743 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1514,"thread_start_us":404,"threads_started":1}
I20260811 12:44:15.104183 20067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.090664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:39683 (local address 127.0.0.1:59432)
0811 12:44:15.091688 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:15.091727 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:15.091898 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:15.095307 (+ 3409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:15.095311 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:15.095340 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:15.095749 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.095764 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.097974 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.097990 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.100636 (+ 2646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.100649 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.103227 (+ 2578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.103234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.103404 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.103438 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 12:44:15.103562 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 12:44:15.103717 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"thread_start_us":2300,"threads_started":1}
I20260811 12:44:15.105151 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.091087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59432 (local address 127.0.186.65:39683)
0811 12:44:15.094432 (+ 3345us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.094443 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.094474 (+ 31us) server_negotiation.cc:407] Connection header received
0811 12:44:15.094783 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.094797 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.095077 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.095946 (+ 869us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:15.096159 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.097788 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.100822 (+ 3034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.102607 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.102758 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.103032 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.104547 (+ 1515us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.104764 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3153,"thread_start_us":2980,"threads_started":1}
I20260811 12:44:15.107139 20070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.093518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:41283 (local address 127.0.0.1:58412)
0811 12:44:15.098524 (+ 5006us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:15.098543 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:15.098679 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:15.099642 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:15.099647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:15.099675 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:15.100179 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.100194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.102130 (+ 1936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.102135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.104046 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.104058 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.105889 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.105907 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.106089 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.106124 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 12:44:15.106647 (+ 523us) client_negotiation.cc:240] Negotiation successful
0811 12:44:15.106801 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4837,"thread_start_us":4555,"threads_started":1}
I20260811 12:44:15.107460 19984 tablet_service.cc:1467] Processing CreateTablet for tablet 70d08f501c094286b8b4e8f995046f4b (DEFAULT_TABLE table=test-table [id=2e5a3c502ae6445ab28809f0ccacf44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:44:15.108425 19688 tablet_service.cc:1467] Processing CreateTablet for tablet 70d08f501c094286b8b4e8f995046f4b (DEFAULT_TABLE table=test-table [id=2e5a3c502ae6445ab28809f0ccacf44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:44:15.109086 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d08f501c094286b8b4e8f995046f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:15.109416 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.094157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.0.186.66:41283)
0811 12:44:15.094913 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.094934 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.098671 (+ 3737us) server_negotiation.cc:407] Connection header received
0811 12:44:15.098871 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.098879 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.099126 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.099346 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:15.100393 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.101949 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.104280 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.105627 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.105781 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.105962 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.108859 (+ 2897us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.109066 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":399,"threads_started":1}
I20260811 12:44:15.109932 19688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d08f501c094286b8b4e8f995046f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:15.113193 19839 tablet_service.cc:1467] Processing CreateTablet for tablet 70d08f501c094286b8b4e8f995046f4b (DEFAULT_TABLE table=test-table [id=2e5a3c502ae6445ab28809f0ccacf44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:44:15.114689 19839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d08f501c094286b8b4e8f995046f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:15.124686 20072 tablet_bootstrap.cc:492] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Bootstrap starting.
I20260811 12:44:15.128612 20075 tablet_bootstrap.cc:492] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Bootstrap starting.
I20260811 12:44:15.128752 20072 tablet_bootstrap.cc:654] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:15.130455 20072 log.cc:824] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:15.132128 20076 tablet_bootstrap.cc:492] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Bootstrap starting.
I20260811 12:44:15.132377 20075 tablet_bootstrap.cc:654] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:15.133852 20075 log.cc:824] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:15.135385 20072 tablet_bootstrap.cc:492] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: No bootstrap required, opened a new log
I20260811 12:44:15.135681 20072 ts_tablet_manager.cc:1397] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 12:44:15.136925 20075 tablet_bootstrap.cc:492] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: No bootstrap required, opened a new log
I20260811 12:44:15.137221 20075 ts_tablet_manager.cc:1397] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260811 12:44:15.138738 20076 tablet_bootstrap.cc:654] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:15.140075 20076 log.cc:824] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:15.143476 20076 tablet_bootstrap.cc:492] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: No bootstrap required, opened a new log
I20260811 12:44:15.143759 20076 ts_tablet_manager.cc:1397] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260811 12:44:15.146111 20072 raft_consensus.cc:348] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.146214 20075 raft_consensus.cc:348] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.146584 20072 raft_consensus.cc:374] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:15.146709 20075 raft_consensus.cc:374] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:15.146723 20072 raft_consensus.cc:729] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c501e3dcc14133b0a749a870ce5317, State: Initialized, Role: FOLLOWER
I20260811 12:44:15.146831 20075 raft_consensus.cc:729] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b7fb00fdf1042189b861e3645dd7c04, State: Initialized, Role: FOLLOWER
I20260811 12:44:15.147382 20072 consensus_queue.cc:260] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.147727 20075 consensus_queue.cc:260] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.148919 20054 heartbeater.cc:503] Master 127.0.186.126:35823 was elected leader, sending a full tablet report...
I20260811 12:44:15.149410 20072 ts_tablet_manager.cc:1428] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260811 12:44:15.151239 20075 ts_tablet_manager.cc:1428] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260811 12:44:15.154676 20076 raft_consensus.cc:348] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.155175 20076 raft_consensus.cc:374] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:15.155326 20076 raft_consensus.cc:729] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07cd1cc52b494763922284c059b5e52f, State: Initialized, Role: FOLLOWER
I20260811 12:44:15.155890 20076 consensus_queue.cc:260] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.157212 19912 heartbeater.cc:503] Master 127.0.186.126:35823 was elected leader, sending a full tablet report...
I20260811 12:44:15.157691 20076 ts_tablet_manager.cc:1428] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
W20260811 12:44:15.227663 19761 tablet.cc:2369] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:44:15.233053 19913 tablet.cc:2369] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:44:15.242360 20081 raft_consensus.cc:482] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:44:15.242734 20081 raft_consensus.cc:504] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.244640 20081 leader_election.cc:288] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67:39823), 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283)
W20260811 12:44:15.251319 20055 tablet.cc:2369] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:44:15.253638 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.245092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:41283 (local address 127.0.186.65:41629)
0811 12:44:15.246584 (+ 1492us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:15.246604 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:15.246865 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:15.247387 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:15.247390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:15.247417 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:15.247904 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.247916 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.249574 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.249578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.251110 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.251136 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.252921 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.252926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.253048 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.253074 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 12:44:15.253170 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 12:44:15.253266 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1322,"mutex_wait_us":33,"thread_start_us":971,"threads_started":1}
I20260811 12:44:15.253701 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.245262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:41629 (local address 127.0.186.66:41283)
0811 12:44:15.245464 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.245492 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.246720 (+ 1228us) server_negotiation.cc:407] Connection header received
0811 12:44:15.247112 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.247119 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.247209 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.247328 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:15.248285 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.249434 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.251297 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.252699 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.252916 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.252999 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.253232 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.253385 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:44:15.254057 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.245157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:51089 (local address 127.0.186.67:39823)
0811 12:44:15.245381 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.245388 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.246193 (+ 805us) server_negotiation.cc:407] Connection header received
0811 12:44:15.246662 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.246668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.246764 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.246856 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:15.247913 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.248990 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.251173 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.252707 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.252924 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.252999 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.253666 (+ 667us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.253840 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:44:15.254177 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.245092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:39823 (local address 127.0.186.65:51089)
0811 12:44:15.246035 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:15.246065 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:15.246379 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:15.247154 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:15.247159 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:15.247195 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:15.247679 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.247690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.249150 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.249156 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.250974 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:15.250992 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.253233 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.253242 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:15.253442 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.253478 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 12:44:15.253601 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 12:44:15.253748 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"mutex_wait_us":10,"thread_start_us":478,"threads_started":1}
I20260811 12:44:15.255525 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d08f501c094286b8b4e8f995046f4b" candidate_uuid: "2b7fb00fdf1042189b861e3645dd7c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07cd1cc52b494763922284c059b5e52f" is_pre_election: true
I20260811 12:44:15.255522 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d08f501c094286b8b4e8f995046f4b" candidate_uuid: "2b7fb00fdf1042189b861e3645dd7c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c501e3dcc14133b0a749a870ce5317" is_pre_election: true
I20260811 12:44:15.256137 19860 raft_consensus.cc:2454] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b7fb00fdf1042189b861e3645dd7c04 in term 0.
I20260811 12:44:15.256137 20005 raft_consensus.cc:2454] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b7fb00fdf1042189b861e3645dd7c04 in term 0.
I20260811 12:44:15.256992 19638 leader_election.cc:302] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 07cd1cc52b494763922284c059b5e52f, 2b7fb00fdf1042189b861e3645dd7c04, 43c501e3dcc14133b0a749a870ce5317; no voters:
I20260811 12:44:15.257403 20081 raft_consensus.cc:2781] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:44:15.257568 20081 raft_consensus.cc:482] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:44:15.257679 20081 raft_consensus.cc:3037] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:15.259974 20081 raft_consensus.cc:504] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.260655 20081 leader_election.cc:288] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [CANDIDATE]: Term 1 election: Requested vote from peers 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67:39823), 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283)
I20260811 12:44:15.261245 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d08f501c094286b8b4e8f995046f4b" candidate_uuid: "2b7fb00fdf1042189b861e3645dd7c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c501e3dcc14133b0a749a870ce5317"
I20260811 12:44:15.261348 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d08f501c094286b8b4e8f995046f4b" candidate_uuid: "2b7fb00fdf1042189b861e3645dd7c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07cd1cc52b494763922284c059b5e52f"
I20260811 12:44:15.261502 20005 raft_consensus.cc:3037] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:15.261616 19860 raft_consensus.cc:3037] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:15.264006 20005 raft_consensus.cc:2454] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b7fb00fdf1042189b861e3645dd7c04 in term 1.
I20260811 12:44:15.264101 19860 raft_consensus.cc:2454] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b7fb00fdf1042189b861e3645dd7c04 in term 1.
I20260811 12:44:15.264503 19638 leader_election.cc:302] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b7fb00fdf1042189b861e3645dd7c04, 43c501e3dcc14133b0a749a870ce5317; no voters:
I20260811 12:44:15.264885 20081 raft_consensus.cc:2781] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:44:15.265480 20081 raft_consensus.cc:686] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b7fb00fdf1042189b861e3645dd7c04, State: Running, Role: LEADER
I20260811 12:44:15.266021 20081 consensus_queue.cc:237] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } }
I20260811 12:44:15.271369 19550 catalog_manager.cc:5495] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65). New cstate: current_term: 1 leader_uuid: "2b7fb00fdf1042189b861e3645dd7c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b7fb00fdf1042189b861e3645dd7c04" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 } health_report { overall_health: UNKNOWN } } }
I20260811 12:44:15.300201 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.294405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59438 (local address 127.0.186.65:39683)
0811 12:44:15.294675 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.294683 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.294703 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:44:15.294807 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.294811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.294948 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.295155 (+ 207us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:44:15.295576 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.296340 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.297853 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.298276 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.298445 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.298987 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:44:15.299543 (+ 556us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:44:15.299757 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.299819 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.299909 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 12:44:15.309405 19860 raft_consensus.cc:1261] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Refusing update from remote peer 2b7fb00fdf1042189b861e3645dd7c04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:44:15.309396 20005 raft_consensus.cc:1261] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Refusing update from remote peer 2b7fb00fdf1042189b861e3645dd7c04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:44:15.310523 20086 consensus_queue.cc:1035] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07cd1cc52b494763922284c059b5e52f" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 41283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:44:15.310916 20081 consensus_queue.cc:1035] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c501e3dcc14133b0a749a870ce5317" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:44:15.322631 20089 mvcc.cc:205] Tried to move back new op lower bound from 7317308437735514112 to 7317308437573722112. Current Snapshot: MvccSnapshot[applied={T|T < 7317308437735514112}]
I20260811 12:44:15.328359 20092 mvcc.cc:205] Tried to move back new op lower bound from 7317308437735514112 to 7317308437573722112. Current Snapshot: MvccSnapshot[applied={T|T < 7317308437735514112}]
I20260811 12:44:15.339437 19550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:44:15.339803 19550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:44:15.343873 19550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Sending DeleteTablet for 3 replicas of tablet 70d08f501c094286b8b4e8f995046f4b
I20260811 12:44:15.345376 19839 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d08f501c094286b8b4e8f995046f4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:44:15 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:58412
I20260811 12:44:15.345621 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d08f501c094286b8b4e8f995046f4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:44:15 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:52160
I20260811 12:44:15.346146 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 19595
I20260811 12:44:15.346213 19688 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d08f501c094286b8b4e8f995046f4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:44:15 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:59432
I20260811 12:44:15.358332 20100 tablet_replica.cc:330] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: stopping tablet replica
I20260811 12:44:15.359032 20102 tablet_replica.cc:330] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: stopping tablet replica
I20260811 12:44:15.359714 20102 raft_consensus.cc:2229] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:44:15.360343 20100 raft_consensus.cc:2229] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:44:15.361045 20100 raft_consensus.cc:2258] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:44:15.361829 20102 raft_consensus.cc:2258] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:44:15.364684 20101 tablet_replica.cc:330] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: stopping tablet replica
I20260811 12:44:15.365190 20101 raft_consensus.cc:2229] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:44:15.365773 20101 raft_consensus.cc:2258] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:44:15.366065 20102 ts_tablet_manager.cc:1905] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:44:15.367754 20100 ts_tablet_manager.cc:1905] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:44:15.369688 20101 ts_tablet_manager.cc:1905] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:44:15.374634 20100 ts_tablet_manager.cc:1918] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:44:15.374835 20100 log.cc:1196] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/70d08f501c094286b8b4e8f995046f4b
I20260811 12:44:15.375420 20100 ts_tablet_manager.cc:1939] T 70d08f501c094286b8b4e8f995046f4b P 07cd1cc52b494763922284c059b5e52f: Deleting consensus metadata
I20260811 12:44:15.375597 20102 ts_tablet_manager.cc:1918] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:44:15.377102 20102 log.cc:1196] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/70d08f501c094286b8b4e8f995046f4b
I20260811 12:44:15.377108 20101 ts_tablet_manager.cc:1918] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:44:15.377338 20101 log.cc:1196] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/70d08f501c094286b8b4e8f995046f4b
I20260811 12:44:15.377537 19533 catalog_manager.cc:4841] TS 07cd1cc52b494763922284c059b5e52f (127.0.186.66:41283): tablet 70d08f501c094286b8b4e8f995046f4b (table test-table [id=2e5a3c502ae6445ab28809f0ccacf44d]) successfully deleted
I20260811 12:44:15.377712 20102 ts_tablet_manager.cc:1939] T 70d08f501c094286b8b4e8f995046f4b P 2b7fb00fdf1042189b861e3645dd7c04: Deleting consensus metadata
I20260811 12:44:15.377925 20101 ts_tablet_manager.cc:1939] T 70d08f501c094286b8b4e8f995046f4b P 43c501e3dcc14133b0a749a870ce5317: Deleting consensus metadata
I20260811 12:44:15.378932 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.347959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.0.186.65:39683)
0811 12:44:15.348178 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.348187 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.348216 (+ 29us) server_negotiation.cc:407] Connection header received
0811 12:44:15.348296 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.348304 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.348418 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.348549 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:15.351167 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.352940 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.355531 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.356555 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.356718 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.361075 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:15.361093 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:15.361110 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:15.361175 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:15.366501 (+ 5326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.367639 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.367647 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.367651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.367941 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.368515 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.368519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.368522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.376459 (+ 7937us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:15.376942 (+ 483us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.378260 (+ 1318us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.378550 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 12:44:15.379611 19535 catalog_manager.cc:4841] TS 43c501e3dcc14133b0a749a870ce5317 (127.0.186.67:39823): tablet 70d08f501c094286b8b4e8f995046f4b (table test-table [id=2e5a3c502ae6445ab28809f0ccacf44d]) successfully deleted
I20260811 12:44:15.379916 19754 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:15.379911 19533 catalog_manager.cc:4841] TS 2b7fb00fdf1042189b861e3645dd7c04 (127.0.186.65:39683): tablet 70d08f501c094286b8b4e8f995046f4b (table test-table [id=2e5a3c502ae6445ab28809f0ccacf44d]) successfully deleted
I20260811 12:44:15.500828 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 19595
I20260811 12:44:15.527871 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 19764
I20260811 12:44:15.542340 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.528665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.0.186.66:41283)
0811 12:44:15.528863 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.528867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.528886 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:44:15.529113 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.529117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.529203 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.529297 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:15.530594 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.531419 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.532702 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.533409 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.533525 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.536335 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:15.536350 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:15.536366 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:15.536405 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:15.539354 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.540099 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.540106 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.540108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.540239 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.540570 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.540573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.540575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.541127 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:15.541356 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.541631 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.541804 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 12:44:15.543131 19907 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:15.639217 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 19764
I20260811 12:44:15.663815 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 19916
I20260811 12:44:15.679173 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:15.664793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.0.186.67:39823)
0811 12:44:15.664993 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:15.664998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:15.665018 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:44:15.665206 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:15.665210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:15.665276 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:15.665365 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:15.667053 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.667803 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.669385 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:15.669762 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:15.669858 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:15.672681 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:15.672698 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:15.672715 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:15.672803 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:15.675730 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.676600 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.676608 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.676611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.676851 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:15.677401 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:15.677405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:15.677407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:15.677885 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:15.678205 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:15.678574 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 12:44:15.678754 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:44:15.679921 20048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:15.777079 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 19916
I20260811 12:44:15.798251 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 19513
I20260811 12:44:15.799584 19587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:15.917964 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 19513
I20260811 12:44:35.946673 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35823
--webserver_interface=127.0.186.126
--webserver_port=32909
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:44:36.309383 20108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:36.309689 20108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:36.309854 20108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:36.317360 20108 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 12:44:36.317466 20108 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 12:44:36.317543 20108 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 12:44:36.317641 20108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:44:36.317744 20108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:36.317855 20108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:36.317936 20108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:44:36.318017 20108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:44:36.328316 20108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=32909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:36.329769 20108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:36.331202 20108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:36.343945 20116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:36.344035 20113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:36.344008 20118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:36.345276 20108 server_base.cc:1034] running on GCE node
I20260811 12:44:36.346174 20108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:36.347630 20108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:36.348899 20108 hybrid_clock.cc:648] HybridClock initialized: now 1786452276348780 us; error 52 us; skew 500 ppm
I20260811 12:44:36.349275 20108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:36 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452276, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:36.352602 20108 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:44:36.354130 20108 webserver.cc:460] Webserver started at http://127.0.186.126:32909/ using document root <none> and password file <none>
I20260811 12:44:36.354813 20108 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:36.354907 20108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:36.360692 20108 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 12:44:36.363773 20125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:36.365314 20108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:44:36.365504 20108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "2a2e6da5293a4f7b9712bca52d219bbf"
format_stamp: "Formatted at 2026-08-11 12:43:49 on dist-test-slave-qg60"
server_key: "132f030bc57851a7de1320641ba43d66"
server_key_iv: "377dde5e3b8bb6b720ba3dba5ada9b79"
server_key_version: "encryptionkey@0"
I20260811 12:44:36.366534 20108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:36.382332 20108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:36.386651 20108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:36.386951 20108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:36.407549 20108 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35823
I20260811 12:44:36.407586 20182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35823 every 8 connection(s)
I20260811 12:44:36.409240 20108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:44:36.413743 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 20108
I20260811 12:44:36.414676 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:39683
--local_ip_for_outbound_sockets=127.0.186.65
--tserver_master_addrs=127.0.186.126:35823
--webserver_port=40889
--webserver_interface=127.0.186.65
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:44:36.417049 20184 sys_catalog.cc:263] Verifying existing consensus state
I20260811 12:44:36.420969 20184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap starting.
I20260811 12:44:36.442884 20184 log.cc:824] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:36.459929 20184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 12:44:36.460546 20184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Bootstrap complete.
I20260811 12:44:36.470405 20184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:36.471544 20184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a2e6da5293a4f7b9712bca52d219bbf, State: Initialized, Role: FOLLOWER
I20260811 12:44:36.472271 20184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:36.472508 20184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:44:36.472637 20184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:44:36.472870 20184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 2 FOLLOWER]: Advancing to term 3
I20260811 12:44:36.476861 20184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:36.477370 20184 leader_election.cc:302] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a2e6da5293a4f7b9712bca52d219bbf; no voters:
I20260811 12:44:36.478106 20184 leader_election.cc:288] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 12:44:36.478251 20190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 12:44:36.479583 20190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [term 3 LEADER]: Becoming Leader. State: Replica: 2a2e6da5293a4f7b9712bca52d219bbf, State: Running, Role: LEADER
I20260811 12:44:36.480304 20190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } }
I20260811 12:44:36.480573 20184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:44:36.483323 20192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a2e6da5293a4f7b9712bca52d219bbf. Latest consensus state: current_term: 3 leader_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } } }
I20260811 12:44:36.483765 20192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:36.484403 20191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2e6da5293a4f7b9712bca52d219bbf" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35823 } } }
I20260811 12:44:36.484763 20191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:36.490347 20195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:44:36.501780 20195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:44:36.503965 20195 catalog_manager.cc:1259] Loaded cluster ID: 70dc876803a642a9a0d482874edbc5df
I20260811 12:44:36.504168 20195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:44:36.509903 20195 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:44:36.512437 20195 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Loaded TSK: 0
I20260811 12:44:36.512827 20195 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2a2e6da5293a4f7b9712bca52d219bbf: Loaded TSK: 1
F20260811 12:44:36.514539 20195 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9ed23a79ad google::LogMessage::Fail() at ??:0
@ 0x7f9ed23aa88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9ed23a74de google::LogMessage::Flush() at ??:0
@ 0x7f9ed23a8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9ed610b7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f9ed60fa73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f9ee7dda1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f9ee7dd9783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f9ee7e652a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f9ee7e650c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f9ee7eaf5e9 std::function<>::operator()() at ??:0
@ 0x7f9ee7dddcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
I20260811 12:44:36.593333 20214 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f9ee7ddbc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9ee7e63610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9ee7e63439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9ed4ff3345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9ed4ff691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9ed4ff6799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9ed4fd1eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9ed82ab6db start_thread at ??:0
@ 0x7f9ed124161f clone at ??:0
W20260811 12:44:36.873565 20187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:36.873871 20187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:36.874073 20187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:36.881879 20187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:36.882010 20187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:36.882234 20187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:44:36.893119 20187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:39683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=40889
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:36.894510 20187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:36.895915 20187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:36.909698 20236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:36.909735 20240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:36.909782 20237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:36.910897 20187 server_base.cc:1034] running on GCE node
I20260811 12:44:36.911533 20187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:36.912488 20187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:36.913766 20187 hybrid_clock.cc:648] HybridClock initialized: now 1786452276913694 us; error 77 us; skew 500 ppm
I20260811 12:44:36.914165 20187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:36 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452276, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:36.917603 20187 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:44:36.919323 20187 webserver.cc:460] Webserver started at http://127.0.186.65:40889/ using document root <none> and password file <none>
I20260811 12:44:36.920107 20187 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:36.920266 20187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:36.926157 20187 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 12:44:36.929121 20247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:36.930502 20187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:44:36.930691 20187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "2b7fb00fdf1042189b861e3645dd7c04"
format_stamp: "Formatted at 2026-08-11 12:43:50 on dist-test-slave-qg60"
server_key: "c5c15dc6a5ffb7aba705fb5d10a79566"
server_key_iv: "7e102c750b6f4a249681fa5b084c96c4"
server_key_version: "encryptionkey@0"
I20260811 12:44:36.931792 20187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:36.950378 20187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:36.954591 20187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:36.954905 20187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:36.955993 20187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:36.957530 20187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:36.957657 20187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:36.957811 20187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:36.957901 20187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:36.994807 20187 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:39683
I20260811 12:44:36.994896 20374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:39683 every 8 connection(s)
I20260811 12:44:36.996313 20187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:44:36.999049 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 20187
I20260811 12:44:36.999784 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:41283
--local_ip_for_outbound_sockets=127.0.186.66
--tserver_master_addrs=127.0.186.126:35823
--webserver_port=42675
--webserver_interface=127.0.186.66
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:44:37.002158 20377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:36.999537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:40433)
0811 12:44:37.000535 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.000885 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":393,"threads_started":1}
W20260811 12:44:37.003038 20375 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:35823 (0 consecutive failures): Network error: Failed to ping master at 127.0.186.126:35823: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
I20260811 12:44:37.004251 20377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.003730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:36423)
0811 12:44:37.003949 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.004073 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 12:44:37.005508 20377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.005023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:55515)
0811 12:44:37.005209 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.005319 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 12:44:37.005789 20375 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 12:44:37.361925 20378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:37.362214 20378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:37.362401 20378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:37.370010 20378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:37.370146 20378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:37.370324 20378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:44:37.380683 20378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:41283
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=42675
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:37.382090 20378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:37.383493 20378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:37.397370 20386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:37.397500 20384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:37.397461 20383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:37.398512 20378 server_base.cc:1034] running on GCE node
I20260811 12:44:37.399243 20378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:37.400312 20378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:37.401561 20378 hybrid_clock.cc:648] HybridClock initialized: now 1786452277401502 us; error 49 us; skew 500 ppm
I20260811 12:44:37.401911 20378 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:37 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452277, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:37.405236 20378 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:44:37.406810 20378 webserver.cc:460] Webserver started at http://127.0.186.66:42675/ using document root <none> and password file <none>
I20260811 12:44:37.407546 20378 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:37.407699 20378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:37.413560 20378 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 12:44:37.416388 20393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:37.417905 20378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 12:44:37.418112 20378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "07cd1cc52b494763922284c059b5e52f"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "b0dfd9b52cae6b7808c9c8c895325035"
server_key_iv: "ec30057931a61f1e0976b5ea194aafe1"
server_key_version: "encryptionkey@0"
I20260811 12:44:37.419121 20378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:37.445019 20378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:37.449126 20378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:37.449424 20378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:37.450533 20378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:37.452024 20378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:37.452199 20378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:37.452334 20378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:37.452425 20378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:37.487444 20378 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:41283
I20260811 12:44:37.487529 20523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:41283 every 8 connection(s)
I20260811 12:44:37.489025 20378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:44:37.491479 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 20378
I20260811 12:44:37.492147 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:39823
--local_ip_for_outbound_sockets=127.0.186.67
--tserver_master_addrs=127.0.186.126:35823
--webserver_port=38185
--webserver_interface=127.0.186.67
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:44:37.494335 20526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.492132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:43467)
0811 12:44:37.493066 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.493396 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":375,"threads_started":1}
W20260811 12:44:37.495188 20524 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:35823 (0 consecutive failures): Network error: Failed to ping master at 127.0.186.126:35823: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
I20260811 12:44:37.496214 20526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.495857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:59131)
0811 12:44:37.496019 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.496100 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 12:44:37.497241 20526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.496919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:55249)
0811 12:44:37.497053 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.497130 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 12:44:37.497529 20524 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 12:44:37.852262 20527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:37.852578 20527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:37.852679 20527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:37.860237 20527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:37.860368 20527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:37.860484 20527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:44:37.870865 20527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:39823
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=38185
--tserver_master_addrs=127.0.186.126:35823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:37.872205 20527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:37.873682 20527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:37.887452 20533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:37.887392 20532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:37.887416 20535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:37.888338 20527 server_base.cc:1034] running on GCE node
I20260811 12:44:37.889109 20527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:37.890130 20527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:37.891337 20527 hybrid_clock.cc:648] HybridClock initialized: now 1786452277891288 us; error 37 us; skew 500 ppm
I20260811 12:44:37.891657 20527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:37 dist-test-slave-qg60 krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452277, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:37.894960 20527 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:44:37.897056 20527 webserver.cc:460] Webserver started at http://127.0.186.67:38185/ using document root <none> and password file <none>
I20260811 12:44:37.897821 20527 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:37.897974 20527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:37.903633 20527 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 12:44:37.908370 20543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:37.910065 20527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:44:37.910270 20527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "43c501e3dcc14133b0a749a870ce5317"
format_stamp: "Formatted at 2026-08-11 12:43:51 on dist-test-slave-qg60"
server_key: "ffec3006199850dfe21eeb4d69165a12"
server_key_iv: "9be0cfed7441bd694b71493ee6f84a18"
server_key_version: "encryptionkey@0"
I20260811 12:44:37.911379 20527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:37.930444 20527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:37.934924 20527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:37.935292 20527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:37.936496 20527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:37.937968 20527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:37.938109 20527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:37.938243 20527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:37.938333 20527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:37.975392 20527 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:39823
I20260811 12:44:37.975482 20669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:39823 every 8 connection(s)
I20260811 12:44:37.976969 20527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:44:37.979131 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 20527
I20260811 12:44:37.982920 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.980715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:52243)
0811 12:44:37.981601 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.981879 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":415,"threads_started":1}
W20260811 12:44:37.983644 20670 heartbeater.cc:644] Failed to heartbeat to 127.0.186.126:35823 (0 consecutive failures): Network error: Failed to ping master at 127.0.186.126:35823: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
I20260811 12:44:37.984489 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.984140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:57959)
0811 12:44:37.984311 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.984379 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 12:44:37.985371 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:37.985037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:37507)
0811 12:44:37.985178 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:37.985266 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 12:44:37.985656 20670 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 12:44:38.007413 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:38.006408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:58061)
0811 12:44:38.006994 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:38.007140 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":289,"threads_started":1}
I20260811 12:44:38.499279 20676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:38.498223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:58097)
0811 12:44:38.498749 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:38.498848 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":268,"threads_started":1}
I20260811 12:44:38.987267 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:38.986308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:32799)
0811 12:44:38.986894 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:38.987001 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":330,"threads_started":1}
I20260811 12:44:39.009512 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:39.008581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:43905)
0811 12:44:39.009234 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:39.009329 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":355,"threads_started":1}
I20260811 12:44:39.501147 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:39.500296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:44311)
0811 12:44:39.500868 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:39.500963 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":290,"threads_started":1}
I20260811 12:44:39.989032 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:39.988213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:45345)
0811 12:44:39.988682 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:39.988842 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":236,"threads_started":1}
I20260811 12:44:40.011344 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:40.010449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:50409)
0811 12:44:40.011039 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:40.011158 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":354,"threads_started":1}
I20260811 12:44:40.502878 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:40.502080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:39041)
0811 12:44:40.502596 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:40.502691 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":250,"threads_started":1}
I20260811 12:44:40.991031 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:40.990139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:42277)
0811 12:44:40.990703 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:40.990806 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":328,"threads_started":1}
I20260811 12:44:41.013741 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:41.012536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:59143)
0811 12:44:41.013363 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:41.013453 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":575,"threads_started":1}
I20260811 12:44:41.504710 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:41.503911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:48961)
0811 12:44:41.504429 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:41.504522 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":283,"threads_started":1}
I20260811 12:44:41.992841 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:41.992010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:40407)
0811 12:44:41.992510 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:41.992605 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":273,"threads_started":1}
I20260811 12:44:42.015830 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:42.014826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:41131)
0811 12:44:42.015540 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:42.015636 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":399,"threads_started":1}
I20260811 12:44:42.506690 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:42.505901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:37233)
0811 12:44:42.506414 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:42.506506 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":269,"threads_started":1}
I20260811 12:44:42.994740 20693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:42.993863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:37323)
0811 12:44:42.994432 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:42.994527 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":270,"threads_started":1}
I20260811 12:44:43.017891 20694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:43.016901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:59325)
0811 12:44:43.017446 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:43.017620 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":293,"threads_started":1}
I20260811 12:44:43.508487 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:43.507680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:37359)
0811 12:44:43.508205 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:43.508312 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":261,"threads_started":1}
I20260811 12:44:43.996636 20696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:43.995715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:49179)
0811 12:44:43.996305 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:43.996430 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":271,"threads_started":1}
I20260811 12:44:44.020217 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:44.019163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:43881)
0811 12:44:44.019865 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:44.019976 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":372,"threads_started":1}
I20260811 12:44:44.510634 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:44.509664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:60763)
0811 12:44:44.510285 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:44.510386 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":281,"threads_started":1}
I20260811 12:44:44.998589 20699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:44.997723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:53311)
0811 12:44:44.998275 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:44.998358 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":265,"threads_started":1}
I20260811 12:44:45.022066 20700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:45.021262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:49939)
0811 12:44:45.021795 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:45.021885 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":292,"threads_started":1}
I20260811 12:44:45.512676 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:45.511733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:56341)
0811 12:44:45.512400 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:45.512496 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":245,"threads_started":1}
I20260811 12:44:46.000512 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:45.999598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:34913)
0811 12:44:46.000143 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:46.000275 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":274,"threads_started":1}
I20260811 12:44:46.024263 20703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:46.023138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:37605)
0811 12:44:46.023971 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:46.024068 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":541,"threads_started":1}
I20260811 12:44:46.514709 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:46.513726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:56171)
0811 12:44:46.514337 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:46.514478 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":259,"threads_started":1}
I20260811 12:44:47.002326 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:47.001525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:60481)
0811 12:44:47.002029 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:47.002145 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":240,"threads_started":1}
I20260811 12:44:47.025988 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:47.025268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:57447)
0811 12:44:47.025734 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:47.025821 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":249,"threads_started":1}
I20260811 12:44:47.516842 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:47.515896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:49891)
0811 12:44:47.516513 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:47.516610 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":388,"threads_started":1}
I20260811 12:44:48.004679 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:48.003539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:58291)
0811 12:44:48.004207 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:48.004331 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":338,"threads_started":1}
I20260811 12:44:48.027833 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:48.026945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:51097)
0811 12:44:48.027537 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:48.027640 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":272,"threads_started":1}
I20260811 12:44:48.518689 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:48.517871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:39955)
0811 12:44:48.518370 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:48.518481 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":255,"threads_started":1}
I20260811 12:44:49.006781 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:49.005888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:38665)
0811 12:44:49.006475 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:49.006578 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":342,"threads_started":1}
I20260811 12:44:49.029770 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:49.029015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:35773)
0811 12:44:49.029506 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:49.029595 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":240,"threads_started":1}
I20260811 12:44:49.520633 20713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:49.519793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:52359)
0811 12:44:49.520372 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:49.520464 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":334,"threads_started":1}
I20260811 12:44:50.008957 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:50.008041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:50585)
0811 12:44:50.008573 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:50.008703 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":258,"threads_started":1}
I20260811 12:44:50.031630 20715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:50.030802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:49643)
0811 12:44:50.031320 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:50.031414 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":278,"threads_started":1}
I20260811 12:44:50.522655 20716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:50.521674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:52869)
0811 12:44:50.522342 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:50.522451 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":381,"threads_started":1}
I20260811 12:44:51.010977 20717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:51.010135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:47747)
0811 12:44:51.010670 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:51.010780 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":261,"threads_started":1}
I20260811 12:44:51.033471 20718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:51.032623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:60007)
0811 12:44:51.033180 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:51.033276 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":294,"threads_started":1}
I20260811 12:44:51.524575 20719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:51.523711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:58857)
0811 12:44:51.524286 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:51.524381 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":339,"threads_started":1}
I20260811 12:44:52.012995 20720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:52.012094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:44535)
0811 12:44:52.012632 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:52.012794 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":312,"threads_started":1}
I20260811 12:44:52.035964 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:52.035061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.65:47005)
0811 12:44:52.035674 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:52.035766 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":329,"threads_started":1}
I20260811 12:44:52.526551 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:52.525711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.66:33705)
0811 12:44:52.526235 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:52.526348 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":259,"threads_started":1}
I20260811 12:44:52.988878 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 20187
I20260811 12:44:53.015170 20725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:53.014323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:35823 (local address 127.0.186.67:41811)
0811 12:44:53.014884 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:53.014980 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.126:35823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":306,"threads_started":1}
I20260811 12:44:53.018505 20723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:52.990276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.0.186.65:39683)
0811 12:44:52.991268 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:52.991290 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:52.991342 (+ 52us) server_negotiation.cc:407] Connection header received
0811 12:44:52.993008 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:52.993018 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:52.993474 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:52.993784 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:52.995518 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:52.997386 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:52.998804 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:52.999950 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:53.000118 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:53.010916 (+ 10798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:53.010926 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:53.010947 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:53.011008 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:53.014431 (+ 3423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:53.015284 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:53.015313 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:53.015325 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:53.015606 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:53.016078 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:53.016083 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:53.016087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:53.016815 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:53.017157 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:53.017633 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 12:44:53.018118 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":583,"threads_started":1}
I20260811 12:44:53.019907 20368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:53.107798 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 20187
I20260811 12:44:53.133164 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 20378
I20260811 12:44:53.151898 20728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:53.134286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42502 (local address 127.0.186.66:41283)
0811 12:44:53.134908 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:53.134923 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:53.134963 (+ 40us) server_negotiation.cc:407] Connection header received
0811 12:44:53.136645 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:53.136658 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:53.137199 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:53.137503 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:53.138908 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:53.140192 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:53.141606 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:53.142345 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:53.142491 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:53.145451 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:53.145459 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:53.145476 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:53.145518 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:53.148580 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:53.149411 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:53.149418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:53.149425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:53.149601 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:53.149978 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:53.149981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:53.149983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:53.150506 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:53.150750 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:53.151167 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 12:44:53.151609 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":340,"threads_started":1}
I20260811 12:44:53.153384 20516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:53.241434 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 20378
I20260811 12:44:53.264911 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 20527
I20260811 12:44:53.283964 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:53.265938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40436 (local address 127.0.186.67:39823)
0811 12:44:53.266596 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:53.266613 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:53.266660 (+ 47us) server_negotiation.cc:407] Connection header received
0811 12:44:53.268390 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:53.268402 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:53.268995 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:53.269372 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:53.270912 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:53.272146 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:53.273557 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:53.274247 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:53.274457 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:53.277315 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:53.277323 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:53.277339 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:53.277379 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:53.280394 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:53.281229 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:53.281237 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:53.281244 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:53.281420 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:53.281851 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:53.281854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:53.281857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:53.282400 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:53.282720 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:53.283213 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 12:44:53.283639 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":313,"threads_started":1}
I20260811 12:44:53.285538 20664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:53.377755 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 20527
2026-08-11T12:44:53Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65390 ms)
[----------] 30 tests from SecurityITest (320610 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:44:53 dist-test-slave-qg60 krb5kdc[20735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:44:53 dist-test-slave-qg60 krb5kdc[20735](info): set up 2 sockets
Aug 11 12:44:53 dist-test-slave-qg60 krb5kdc[20735](info): commencing operation
krb5kdc: starting...
W20260811 12:44:54.644829 745 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.003s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:44:54 dist-test-slave-qg60 krb5kdc[20735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:44:55.022650 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:38097
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:38097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:44:55.405560 20748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:55.405956 20748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:55.406100 20748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:55.415056 20748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:44:55.415273 20748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:55.415410 20748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:55.415539 20748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:44:55.415643 20748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:44:55.427973 20748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:38097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:38097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:55.429613 20748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:55.431083 20748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:55.444283 20754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:55.444695 20758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:55.444795 20756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:55.445374 20748 server_base.cc:1034] running on GCE node
I20260811 12:44:55.446549 20748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:55.448093 20748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:55.449321 20748 hybrid_clock.cc:648] HybridClock initialized: now 1786452295449262 us; error 43 us; skew 500 ppm
I20260811 12:44:55.449756 20748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:55 dist-test-slave-qg60 krb5kdc[20735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452295, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:55.453296 20748 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:44:55.455168 20748 webserver.cc:460] Webserver started at http://127.0.186.126:44833/ using document root <none> and password file <none>
I20260811 12:44:55.455938 20748 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:55.456053 20748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:55.456454 20748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:44:55.459735 20748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "292f160ea55c4927ae6143031cf356a4"
format_stamp: "Formatted at 2026-08-11 12:44:55 on dist-test-slave-qg60"
server_key: "7bde23638d5b93b9ac383cacd46aafd6"
server_key_iv: "901f953ac1447379457dbabd92b3fc24"
server_key_version: "encryptionkey@0"
I20260811 12:44:55.460584 20748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "292f160ea55c4927ae6143031cf356a4"
format_stamp: "Formatted at 2026-08-11 12:44:55 on dist-test-slave-qg60"
server_key: "7bde23638d5b93b9ac383cacd46aafd6"
server_key_iv: "901f953ac1447379457dbabd92b3fc24"
server_key_version: "encryptionkey@0"
I20260811 12:44:55.466450 20748 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 12:44:55.470484 20768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:55.471956 20748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 12:44:55.472155 20748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "292f160ea55c4927ae6143031cf356a4"
format_stamp: "Formatted at 2026-08-11 12:44:55 on dist-test-slave-qg60"
server_key: "7bde23638d5b93b9ac383cacd46aafd6"
server_key_iv: "901f953ac1447379457dbabd92b3fc24"
server_key_version: "encryptionkey@0"
I20260811 12:44:55.472369 20748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:55.522284 20748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:55.527367 20748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:55.527637 20748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:55.549017 20748 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:38097
I20260811 12:44:55.549129 20823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:38097 every 8 connection(s)
I20260811 12:44:55.550557 20748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:44:55.551704 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 20748
I20260811 12:44:55.552052 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:44:55.552989 745 external_mini_cluster.cc:1428] Setting key 51f40949a771b99386121686fe4085fc
I20260811 12:44:55.556030 20824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:44:55 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:55.570533 20824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4: Bootstrap starting.
I20260811 12:44:55.575371 20824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:55.576695 20824 log.cc:824] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:55.580439 20824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4: No bootstrap required, opened a new log
I20260811 12:44:55.580693 20828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:55.555323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36082 (local address 127.0.186.126:38097)
0811 12:44:55.556357 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:55.556368 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:55.556414 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:44:55.558247 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:55.558269 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:55.558648 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:55.559013 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:55.561002 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:55.562553 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:55.564649 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:55.565391 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:55.565539 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:55.570912 (+ 5373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:55.570923 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:55.570943 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:55.570994 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:55.575406 (+ 4412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:55.576540 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:55.576550 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:55.576558 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:55.576823 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:55.577335 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:55.577343 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:55.577354 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:55.578100 (+ 746us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:55.578444 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:55.578823 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 12:44:55.579286 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":835,"thread_start_us":434,"threads_started":1}
I20260811 12:44:55.589092 20824 raft_consensus.cc:348] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "292f160ea55c4927ae6143031cf356a4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38097 } }
I20260811 12:44:55.589488 20824 raft_consensus.cc:374] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:55.589578 20824 raft_consensus.cc:729] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292f160ea55c4927ae6143031cf356a4, State: Initialized, Role: FOLLOWER
I20260811 12:44:55.590101 20824 consensus_queue.cc:260] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "292f160ea55c4927ae6143031cf356a4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38097 } }
I20260811 12:44:55.590296 20824 raft_consensus.cc:388] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:44:55.590394 20824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:44:55.590523 20824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:55.593006 20824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "292f160ea55c4927ae6143031cf356a4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38097 } }
I20260811 12:44:55.593632 20824 leader_election.cc:302] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 292f160ea55c4927ae6143031cf356a4; no voters:
I20260811 12:44:55.594303 20824 leader_election.cc:288] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:44:55.594470 20830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:44:55.595278 20830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [term 1 LEADER]: Becoming Leader. State: Replica: 292f160ea55c4927ae6143031cf356a4, State: Running, Role: LEADER
I20260811 12:44:55.595916 20830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "292f160ea55c4927ae6143031cf356a4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38097 } }
I20260811 12:44:55.596582 20824 sys_catalog.cc:564] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:44:55.600644 20832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 292f160ea55c4927ae6143031cf356a4. Latest consensus state: current_term: 1 leader_uuid: "292f160ea55c4927ae6143031cf356a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "292f160ea55c4927ae6143031cf356a4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38097 } } }
I20260811 12:44:55.600697 20831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "292f160ea55c4927ae6143031cf356a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "292f160ea55c4927ae6143031cf356a4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38097 } } }
I20260811 12:44:55.601130 20832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:55.601214 20831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4 [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:55.602144 20838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:44:55.609091 20838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:44:55.622156 20838 catalog_manager.cc:1347] Generated new cluster ID: 0ceb289a13fd453a8454ddaad5af64ff
I20260811 12:44:55.622280 20838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:44:55.648190 20838 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:44:55.650238 20838 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:44:55.660641 20838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4: Generated new TSK 0
I20260811 12:44:55.661803 20838 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:44:55.749317 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38097
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:44:56.117765 20853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:56.118158 20853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:56.118324 20853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:56.126116 20853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:56.126291 20853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:56.126470 20853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:44:56.136794 20853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:56.138243 20853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:56.139679 20853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:56.153903 20859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:56.153940 20862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:56.153810 20858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:56.155057 20853 server_base.cc:1034] running on GCE node
I20260811 12:44:56.155826 20853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:56.156996 20853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:56.158207 20853 hybrid_clock.cc:648] HybridClock initialized: now 1786452296158156 us; error 39 us; skew 500 ppm
I20260811 12:44:56.158541 20853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:56 dist-test-slave-qg60 krb5kdc[20735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452296, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:56.162340 20853 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:44:56.163931 20853 webserver.cc:460] Webserver started at http://127.0.186.65:46151/ using document root <none> and password file <none>
I20260811 12:44:56.164640 20853 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:56.164801 20853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:56.165113 20853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:44:56.168110 20853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "39a042b64bdc498589d74aa27ad47563"
format_stamp: "Formatted at 2026-08-11 12:44:56 on dist-test-slave-qg60"
server_key: "6e466ff265b282770355c77b822ba073"
server_key_iv: "428b52bd8e44137b59dc273f72ec104a"
server_key_version: "encryptionkey@0"
I20260811 12:44:56.168990 20853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "39a042b64bdc498589d74aa27ad47563"
format_stamp: "Formatted at 2026-08-11 12:44:56 on dist-test-slave-qg60"
server_key: "6e466ff265b282770355c77b822ba073"
server_key_iv: "428b52bd8e44137b59dc273f72ec104a"
server_key_version: "encryptionkey@0"
I20260811 12:44:56.174337 20853 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:44:56.178179 20870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:56.179629 20853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:44:56.179773 20853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "39a042b64bdc498589d74aa27ad47563"
format_stamp: "Formatted at 2026-08-11 12:44:56 on dist-test-slave-qg60"
server_key: "6e466ff265b282770355c77b822ba073"
server_key_iv: "428b52bd8e44137b59dc273f72ec104a"
server_key_version: "encryptionkey@0"
I20260811 12:44:56.179960 20853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:56.206909 20853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:56.211453 20853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:56.211726 20853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:56.212782 20853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:56.214159 20853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:56.214236 20853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:56.214321 20853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:56.214366 20853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:56.249997 20853 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:44123
I20260811 12:44:56.250097 20996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:44123 every 8 connection(s)
I20260811 12:44:56.251334 20853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:44:56.257666 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 20853
I20260811 12:44:56.257927 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:44:56.258849 745 external_mini_cluster.cc:1428] Setting key 446c45d84f98a85d297fed51a8018a59
Aug 11 12:44:56 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452296, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:56.275403 20999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:56.254175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:53725 (local address 127.0.186.126:38097)
0811 12:44:56.254698 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:56.254703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:56.255372 (+ 669us) server_negotiation.cc:407] Connection header received
0811 12:44:56.257558 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:56.257564 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:56.257636 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:56.257726 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:56.259822 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.260712 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.262542 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.263313 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.263487 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:56.267693 (+ 4206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:56.267702 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:56.267710 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:56.267763 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:56.271700 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:56.272585 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:56.272593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:56.272599 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:56.272787 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:56.273259 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:56.273266 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:56.273272 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:56.273678 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:56.273831 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:56.274638 (+ 807us) server_negotiation.cc:299] Negotiation successful
0811 12:44:56.274905 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":291,"threads_started":1}
I20260811 12:44:56.276250 21000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:56.254468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38097 (local address 127.0.186.65:53725)
0811 12:44:56.255198 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:56.255241 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:56.257199 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:56.258048 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:56.258061 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:56.258866 (+ 805us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:56.259666 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:56.259688 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.260921 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.260927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:56.262322 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:56.262336 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.263596 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.263602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:56.263805 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:56.264606 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:44:56.264633 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:56.267383 (+ 2750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:56.271886 (+ 4503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:56.271894 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:56.271910 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:56.272419 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:56.272911 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:56.272915 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:56.272917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:56.273140 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:56.273834 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:56.273841 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:56.274218 (+ 377us) client_negotiation.cc:769] Sending connection context
0811 12:44:56.274497 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 12:44:56.274932 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":281,"threads_started":1}
I20260811 12:44:56.278196 20997 heartbeater.cc:347] Connected to a master server at 127.0.186.126:38097
I20260811 12:44:56.278589 20997 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:56.279556 20997 heartbeater.cc:511] Master 127.0.186.126:38097 requested a full tablet report, sending...
I20260811 12:44:56.282259 20786 ts_manager.cc:194] Registered new tserver with Master: 39a042b64bdc498589d74aa27ad47563 (127.0.186.65:44123)
I20260811 12:44:56.284548 20786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:53725
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:44:56.344887 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38097
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:44:56.730598 21004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:56.730901 21004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:56.731010 21004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:56.739068 21004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:56.739193 21004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:56.739310 21004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:44:56.753825 21004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:56.755249 21004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:56.756623 21004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:56.770972 21009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:56.770972 21010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:56.770874 21012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:56.771713 21004 server_base.cc:1034] running on GCE node
I20260811 12:44:56.772362 21004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:56.773447 21004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:56.774660 21004 hybrid_clock.cc:648] HybridClock initialized: now 1786452296774621 us; error 40 us; skew 500 ppm
I20260811 12:44:56.774951 21004 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:56 dist-test-slave-qg60 krb5kdc[20735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452296, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:56.778553 21004 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:44:56.781051 21004 webserver.cc:460] Webserver started at http://127.0.186.66:45351/ using document root <none> and password file <none>
I20260811 12:44:56.781872 21004 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:56.782045 21004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:56.782457 21004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:44:56.785946 21004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "abe0925ef594429dbab70bea992e2667"
format_stamp: "Formatted at 2026-08-11 12:44:56 on dist-test-slave-qg60"
server_key: "5d949a433be354268502e7bbcfc9b2c5"
server_key_iv: "ff354062f490372eba1ef05db40654de"
server_key_version: "encryptionkey@0"
I20260811 12:44:56.786733 21004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "abe0925ef594429dbab70bea992e2667"
format_stamp: "Formatted at 2026-08-11 12:44:56 on dist-test-slave-qg60"
server_key: "5d949a433be354268502e7bbcfc9b2c5"
server_key_iv: "ff354062f490372eba1ef05db40654de"
server_key_version: "encryptionkey@0"
I20260811 12:44:56.792385 21004 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 12:44:56.796933 21020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:56.798543 21004 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:44:56.798744 21004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "abe0925ef594429dbab70bea992e2667"
format_stamp: "Formatted at 2026-08-11 12:44:56 on dist-test-slave-qg60"
server_key: "5d949a433be354268502e7bbcfc9b2c5"
server_key_iv: "ff354062f490372eba1ef05db40654de"
server_key_version: "encryptionkey@0"
I20260811 12:44:56.798981 21004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:56.830247 21004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:56.835302 21004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:56.835660 21004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:56.836787 21004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:56.838286 21004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:56.838399 21004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:56.838565 21004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:56.838650 21004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:56.878768 21004 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:46413
I20260811 12:44:56.878865 21142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:46413 every 8 connection(s)
I20260811 12:44:56.880254 21004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:44:56.882997 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21004
I20260811 12:44:56.883317 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:44:56.884025 745 external_mini_cluster.cc:1428] Setting key 77beb06911c97e0caf28cd91e5e398ef
Aug 11 12:44:56 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452296, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:56.906438 21145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:56.883286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:49535 (local address 127.0.186.126:38097)
0811 12:44:56.883854 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:56.883862 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:56.885277 (+ 1415us) server_negotiation.cc:407] Connection header received
0811 12:44:56.887354 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:56.887363 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:56.887474 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:56.887624 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:56.889566 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.890865 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.892566 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.893435 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.893638 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:56.897918 (+ 4280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:56.897928 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:56.897937 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:56.897994 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:56.902157 (+ 4163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:56.903421 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:56.903425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:56.903428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:56.903663 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:56.904326 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:56.904329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:56.904332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:56.904683 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:56.904956 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:56.905909 (+ 953us) server_negotiation.cc:299] Negotiation successful
0811 12:44:56.906117 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":268,"threads_started":1}
I20260811 12:44:56.908020 21147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:56.884063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38097 (local address 127.0.186.66:49535)
0811 12:44:56.885089 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:56.885153 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:56.887056 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:56.888065 (+ 1009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:56.888073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:56.888659 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:56.889360 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:56.889379 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.891050 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.891054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:56.892393 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:56.892405 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:56.893729 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:56.893735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:56.893964 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:56.894771 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:44:56.894794 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:56.897594 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:56.902374 (+ 4780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:56.902382 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:56.902398 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:56.903263 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:56.903881 (+ 618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:56.903889 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:56.903895 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:56.904198 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:56.904944 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:56.904955 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:56.905464 (+ 509us) client_negotiation.cc:769] Sending connection context
0811 12:44:56.905794 (+ 330us) client_negotiation.cc:240] Negotiation successful
0811 12:44:56.906410 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":424,"threads_started":1}
I20260811 12:44:56.909878 21143 heartbeater.cc:347] Connected to a master server at 127.0.186.126:38097
I20260811 12:44:56.910264 21143 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:56.911150 21143 heartbeater.cc:511] Master 127.0.186.126:38097 requested a full tablet report, sending...
I20260811 12:44:56.912935 20786 ts_manager.cc:194] Registered new tserver with Master: abe0925ef594429dbab70bea992e2667 (127.0.186.66:46413)
I20260811 12:44:56.914256 20786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:49535
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:44:56.969192 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38097
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:44:57.288684 20997 heartbeater.cc:503] Master 127.0.186.126:38097 was elected leader, sending a full tablet report...
W20260811 12:44:57.346369 21150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:57.346678 21150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:57.346776 21150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:57.354470 21150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:57.354592 21150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:57.354717 21150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:44:57.364979 21150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:57.366457 21150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:57.367909 21150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:57.381908 21155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:57.382107 21156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:57.382417 21158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:57.383316 21150 server_base.cc:1034] running on GCE node
I20260811 12:44:57.383900 21150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:57.385028 21150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:57.386245 21150 hybrid_clock.cc:648] HybridClock initialized: now 1786452297386203 us; error 40 us; skew 500 ppm
I20260811 12:44:57.386620 21150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:44:57 dist-test-slave-qg60 krb5kdc[20735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:44:57.389936 21150 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:44:57.391573 21150 webserver.cc:460] Webserver started at http://127.0.186.67:42737/ using document root <none> and password file <none>
I20260811 12:44:57.392318 21150 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:57.392475 21150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:57.392889 21150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:44:57.396009 21150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "1133391f48ba40468984d06065097027"
format_stamp: "Formatted at 2026-08-11 12:44:57 on dist-test-slave-qg60"
server_key: "c491b1f7a6a470835e4a62d5891b8e7e"
server_key_iv: "a26fe3e1721702227c43d0976277817f"
server_key_version: "encryptionkey@0"
I20260811 12:44:57.397019 21150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "1133391f48ba40468984d06065097027"
format_stamp: "Formatted at 2026-08-11 12:44:57 on dist-test-slave-qg60"
server_key: "c491b1f7a6a470835e4a62d5891b8e7e"
server_key_iv: "a26fe3e1721702227c43d0976277817f"
server_key_version: "encryptionkey@0"
I20260811 12:44:57.402756 21150 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:44:57.406752 21165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:57.408299 21150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:44:57.408506 21150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "1133391f48ba40468984d06065097027"
format_stamp: "Formatted at 2026-08-11 12:44:57 on dist-test-slave-qg60"
server_key: "c491b1f7a6a470835e4a62d5891b8e7e"
server_key_iv: "a26fe3e1721702227c43d0976277817f"
server_key_version: "encryptionkey@0"
I20260811 12:44:57.408802 21150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:57.437987 21150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:57.442360 21150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:57.442744 21150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:57.443787 21150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:57.445212 21150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:57.445297 21150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:57.445386 21150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:57.445431 21150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:57.482900 21150 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:38295
I20260811 12:44:57.483143 21294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:38295 every 8 connection(s)
I20260811 12:44:57.484515 21150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:44:57.489022 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21150
I20260811 12:44:57.489244 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:44:57.489858 745 external_mini_cluster.cc:1428] Setting key eebb9bdd8c8e5aa9746048ffa331a454
Aug 11 12:44:57 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:44:57.508941 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.487487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:56395 (local address 127.0.186.126:38097)
0811 12:44:57.488057 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.488062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.489460 (+ 1398us) server_negotiation.cc:407] Connection header received
0811 12:44:57.491978 (+ 2518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.491983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.492108 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.492211 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:57.494205 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.495022 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.496780 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.497284 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.497383 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.501339 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:57.501344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:57.501348 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:57.501385 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:57.505333 (+ 3948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.506364 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.506368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.506370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.506568 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.507134 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.507138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.507140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.507433 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:57.507569 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.508342 (+ 773us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.508560 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":268,"threads_started":1}
I20260811 12:44:57.509989 21298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.488115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38097 (local address 127.0.186.67:56395)
0811 12:44:57.489249 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.489306 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:57.491635 (+ 2329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:57.492498 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:57.492507 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:57.493300 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:57.494026 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.494045 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.495206 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.495210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.496596 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.496610 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.497534 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.497540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.497760 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.498579 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:44:57.498603 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:57.501083 (+ 2480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:57.505465 (+ 4382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:57.505473 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:57.505488 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:57.506220 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:57.506725 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:44:57.506734 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:44:57.506739 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:44:57.506995 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:44:57.507566 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:57.507573 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:57.507964 (+ 391us) client_negotiation.cc:769] Sending connection context
0811 12:44:57.508214 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 12:44:57.508641 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":397,"threads_started":1}
I20260811 12:44:57.511528 21295 heartbeater.cc:347] Connected to a master server at 127.0.186.126:38097
I20260811 12:44:57.511864 21295 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:57.512780 21295 heartbeater.cc:511] Master 127.0.186.126:38097 requested a full tablet report, sending...
I20260811 12:44:57.514401 20786 ts_manager.cc:194] Registered new tserver with Master: 1133391f48ba40468984d06065097027 (127.0.186.67:38295)
I20260811 12:44:57.515357 20786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:56395
I20260811 12:44:57.519743 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:44:57.538863 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.525101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36088 (local address 127.0.186.126:38097)
0811 12:44:57.525287 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.525292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.525680 (+ 388us) server_negotiation.cc:407] Connection header received
0811 12:44:57.525830 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.525833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.525902 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.526001 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:57.527817 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.528596 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.530202 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.530649 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.530759 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.533585 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:57.533590 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:57.533594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:57.533627 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:57.536283 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.536990 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.536994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.536998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.537138 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.537481 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.537484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.537486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.537816 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:57.538009 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.538436 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.538640 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 12:44:57.543665 20786 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:44:57.551302 20786 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:44:57.579380 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.565362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47216 (local address 127.0.186.67:38295)
0811 12:44:57.566322 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.566335 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.567282 (+ 947us) server_negotiation.cc:407] Connection header received
0811 12:44:57.567780 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.567792 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.568147 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.568357 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:57.569786 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.572093 (+ 2307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.575801 (+ 3708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.577615 (+ 1814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.577758 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.578045 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.578768 (+ 723us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.578989 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":786,"threads_started":1}
I20260811 12:44:57.579386 21310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.565131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:38295 (local address 127.0.0.1:47216)
0811 12:44:57.567085 (+ 1954us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.567147 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:57.567468 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:57.568869 (+ 1401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:57.568880 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:57.568959 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:57.569484 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.569501 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.572375 (+ 2874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.572383 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.575575 (+ 3192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.575592 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.578204 (+ 2612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.578210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.578470 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.578538 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 12:44:57.578694 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 12:44:57.578921 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1614,"thread_start_us":1425,"threads_started":1}
I20260811 12:44:57.584293 21219 tablet_service.cc:1467] Processing CreateTablet for tablet 731ab6bf7379468bb164b6cafd56e709 (DEFAULT_TABLE table=test-table [id=c09ce27933be4153ad888eac98131199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:44:57.585839 21219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 731ab6bf7379468bb164b6cafd56e709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:57.587471 21313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.565992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52372 (local address 127.0.186.66:46413)
0811 12:44:57.577354 (+ 11362us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.577367 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.578175 (+ 808us) server_negotiation.cc:407] Connection header received
0811 12:44:57.578298 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.578308 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.578618 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.579654 (+ 1036us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:57.580604 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.582134 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.584860 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.586341 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.586501 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.586679 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.586988 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.587163 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11121,"thread_start_us":11384,"threads_started":1}
I20260811 12:44:57.587776 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.565603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:46413 (local address 127.0.0.1:52372)
0811 12:44:57.577854 (+ 12251us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.577874 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:57.578020 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:57.578851 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:57.578856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:57.578896 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:57.579310 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.579321 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.582285 (+ 2964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.582293 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.584655 (+ 2362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.584668 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.586579 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.586586 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.586757 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.586799 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 12:44:57.586929 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 12:44:57.587100 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12126,"mutex_wait_us":4,"spinlock_wait_cycles":7040,"thread_start_us":11185,"threads_started":1}
I20260811 12:44:57.588595 21315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.568384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39818 (local address 127.0.186.65:44123)
0811 12:44:57.578165 (+ 9781us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.578177 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.579076 (+ 899us) server_negotiation.cc:407] Connection header received
0811 12:44:57.579187 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.579194 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.579437 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.579661 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:57.580687 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.581984 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.584831 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.586335 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.586490 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.586722 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.587979 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.588148 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9580,"thread_start_us":9412,"threads_started":1}
I20260811 12:44:57.587845 21314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.567568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39818)
0811 12:44:57.578708 (+ 11140us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.578728 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:57.578927 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:57.579905 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:57.579910 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:57.579939 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:57.580414 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.580428 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.582124 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.582129 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.584584 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.584607 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.586870 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.586896 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.587087 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.587124 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 12:44:57.587235 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 12:44:57.587364 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10984,"mutex_wait_us":35,"spinlock_wait_cycles":1920,"thread_start_us":10823,"threads_started":1}
I20260811 12:44:57.591131 21072 tablet_service.cc:1467] Processing CreateTablet for tablet 731ab6bf7379468bb164b6cafd56e709 (DEFAULT_TABLE table=test-table [id=c09ce27933be4153ad888eac98131199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:44:57.592374 21072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 731ab6bf7379468bb164b6cafd56e709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:57.595535 20921 tablet_service.cc:1467] Processing CreateTablet for tablet 731ab6bf7379468bb164b6cafd56e709 (DEFAULT_TABLE table=test-table [id=c09ce27933be4153ad888eac98131199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:44:57.597153 20921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 731ab6bf7379468bb164b6cafd56e709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:57.599094 21316 tablet_bootstrap.cc:492] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Bootstrap starting.
I20260811 12:44:57.603611 21316 tablet_bootstrap.cc:654] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:57.604856 21316 log.cc:824] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:57.608073 21316 tablet_bootstrap.cc:492] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: No bootstrap required, opened a new log
I20260811 12:44:57.608364 21316 ts_tablet_manager.cc:1397] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 12:44:57.614307 21321 tablet_bootstrap.cc:492] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Bootstrap starting.
I20260811 12:44:57.614398 21319 tablet_bootstrap.cc:492] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Bootstrap starting.
I20260811 12:44:57.618239 21319 tablet_bootstrap.cc:654] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:57.618317 21316 raft_consensus.cc:348] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.618817 21316 raft_consensus.cc:374] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:57.618942 21316 raft_consensus.cc:729] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1133391f48ba40468984d06065097027, State: Initialized, Role: FOLLOWER
I20260811 12:44:57.619014 21321 tablet_bootstrap.cc:654] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:57.619596 21319 log.cc:824] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:57.619782 21316 consensus_queue.cc:260] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.620597 21321 log.cc:824] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:57.621265 21295 heartbeater.cc:503] Master 127.0.186.126:38097 was elected leader, sending a full tablet report...
I20260811 12:44:57.621861 21316 ts_tablet_manager.cc:1428] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260811 12:44:57.628506 21321 tablet_bootstrap.cc:492] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: No bootstrap required, opened a new log
I20260811 12:44:57.628504 21319 tablet_bootstrap.cc:492] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: No bootstrap required, opened a new log
I20260811 12:44:57.628856 21321 ts_tablet_manager.cc:1397] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260811 12:44:57.628865 21319 ts_tablet_manager.cc:1397] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.008s
I20260811 12:44:57.640342 21321 raft_consensus.cc:348] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.640342 21319 raft_consensus.cc:348] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.640909 21321 raft_consensus.cc:374] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:57.640921 21319 raft_consensus.cc:374] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:57.641036 21321 raft_consensus.cc:729] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a042b64bdc498589d74aa27ad47563, State: Initialized, Role: FOLLOWER
I20260811 12:44:57.641036 21319 raft_consensus.cc:729] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe0925ef594429dbab70bea992e2667, State: Initialized, Role: FOLLOWER
I20260811 12:44:57.641726 21321 consensus_queue.cc:260] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.641726 21319 consensus_queue.cc:260] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.642967 21143 heartbeater.cc:503] Master 127.0.186.126:38097 was elected leader, sending a full tablet report...
I20260811 12:44:57.643862 21319 ts_tablet_manager.cc:1428] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260811 12:44:57.644408 21321 ts_tablet_manager.cc:1428] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260811 12:44:57.697328 21325 raft_consensus.cc:482] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:44:57.697783 21325 raft_consensus.cc:504] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.699535 21325 leader_election.cc:288] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1133391f48ba40468984d06065097027 (127.0.186.67:38295), 39a042b64bdc498589d74aa27ad47563 (127.0.186.65:44123)
I20260811 12:44:57.707716 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.699940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:49005 (local address 127.0.186.67:38295)
0811 12:44:57.700226 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.700233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.700647 (+ 414us) server_negotiation.cc:407] Connection header received
0811 12:44:57.700978 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.700985 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.701072 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.701145 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:57.702034 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.703186 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.705840 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.706658 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.706906 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.706992 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.707306 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.707438 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 12:44:57.707885 21315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.700840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:55757 (local address 127.0.186.65:44123)
0811 12:44:57.701242 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.701248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.701550 (+ 302us) server_negotiation.cc:407] Connection header received
0811 12:44:57.701790 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.701797 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.701881 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.701984 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:44:57.702755 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.703856 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.706033 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.706847 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.707053 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.707136 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.707494 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.707626 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238}
I20260811 12:44:57.708032 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.700652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.186.66:55757)
0811 12:44:57.701414 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.701429 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:57.701621 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:57.702046 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:57.702052 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:57.702075 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:57.702531 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.702546 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.704057 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.704065 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.705859 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.705872 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.707100 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.707107 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.707322 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.707345 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 12:44:57.707457 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 12:44:57.707591 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"mutex_wait_us":47,"thread_start_us":442,"threads_started":1}
I20260811 12:44:57.708330 21327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.699831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:38295 (local address 127.0.186.66:49005)
0811 12:44:57.700484 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.700528 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:57.700771 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:57.701374 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:57.701378 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:57.701411 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:44:57.701870 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.701883 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.703341 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.703346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.705674 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:57.705687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.706916 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.706923 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:57.707136 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.707162 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 12:44:57.707284 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 12:44:57.707419 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":49,"thread_start_us":366,"threads_started":1}
I20260811 12:44:57.709103 20945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "731ab6bf7379468bb164b6cafd56e709" candidate_uuid: "abe0925ef594429dbab70bea992e2667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a042b64bdc498589d74aa27ad47563" is_pre_election: true
I20260811 12:44:57.709311 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "731ab6bf7379468bb164b6cafd56e709" candidate_uuid: "abe0925ef594429dbab70bea992e2667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1133391f48ba40468984d06065097027" is_pre_election: true
I20260811 12:44:57.709676 20945 raft_consensus.cc:2454] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe0925ef594429dbab70bea992e2667 in term 0.
I20260811 12:44:57.709883 21242 raft_consensus.cc:2454] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe0925ef594429dbab70bea992e2667 in term 0.
I20260811 12:44:57.710412 21024 leader_election.cc:302] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a042b64bdc498589d74aa27ad47563, abe0925ef594429dbab70bea992e2667; no voters:
I20260811 12:44:57.710821 21325 raft_consensus.cc:2781] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:44:57.710992 21325 raft_consensus.cc:482] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:44:57.711114 21325 raft_consensus.cc:3037] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:57.713563 21325 raft_consensus.cc:504] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.714177 21325 leader_election.cc:288] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [CANDIDATE]: Term 1 election: Requested vote from peers 1133391f48ba40468984d06065097027 (127.0.186.67:38295), 39a042b64bdc498589d74aa27ad47563 (127.0.186.65:44123)
I20260811 12:44:57.714679 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "731ab6bf7379468bb164b6cafd56e709" candidate_uuid: "abe0925ef594429dbab70bea992e2667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1133391f48ba40468984d06065097027"
I20260811 12:44:57.714771 20945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "731ab6bf7379468bb164b6cafd56e709" candidate_uuid: "abe0925ef594429dbab70bea992e2667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a042b64bdc498589d74aa27ad47563"
I20260811 12:44:57.714892 21242 raft_consensus.cc:3037] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:57.715090 20945 raft_consensus.cc:3037] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:57.717398 21242 raft_consensus.cc:2454] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe0925ef594429dbab70bea992e2667 in term 1.
I20260811 12:44:57.717564 20945 raft_consensus.cc:2454] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe0925ef594429dbab70bea992e2667 in term 1.
I20260811 12:44:57.717919 21024 leader_election.cc:302] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1133391f48ba40468984d06065097027, abe0925ef594429dbab70bea992e2667; no voters:
I20260811 12:44:57.718266 21325 raft_consensus.cc:2781] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:44:57.718776 21325 raft_consensus.cc:686] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 1 LEADER]: Becoming Leader. State: Replica: abe0925ef594429dbab70bea992e2667, State: Running, Role: LEADER
I20260811 12:44:57.719344 21325 consensus_queue.cc:237] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } }
I20260811 12:44:57.724258 20785 catalog_manager.cc:5495] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 reported cstate change: term changed from 0 to 1, leader changed from <none> to abe0925ef594429dbab70bea992e2667 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "abe0925ef594429dbab70bea992e2667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe0925ef594429dbab70bea992e2667" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 46413 } health_report { overall_health: HEALTHY } } }
W20260811 12:44:57.736363 21296 tablet.cc:2369] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:44:57.745297 21313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.739526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52386 (local address 127.0.186.66:46413)
0811 12:44:57.739754 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.739760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.739780 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:44:57.739998 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.740002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.740091 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.740247 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:44:57.740663 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.741475 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.742990 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.743405 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.743551 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.744072 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:44:57.744567 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:44:57.744727 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.744874 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.744959 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 12:44:57.754138 20998 tablet.cc:2369] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:44:57.754410 21242 raft_consensus.cc:1261] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 1 FOLLOWER]: Refusing update from remote peer abe0925ef594429dbab70bea992e2667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:44:57.754415 20945 raft_consensus.cc:1261] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 1 FOLLOWER]: Refusing update from remote peer abe0925ef594429dbab70bea992e2667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:44:57.755556 21329 consensus_queue.cc:1035] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a042b64bdc498589d74aa27ad47563" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:44:57.755934 21325 consensus_queue.cc:1035] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1133391f48ba40468984d06065097027" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:44:57.767375 21333 mvcc.cc:205] Tried to move back new op lower bound from 7317308611589902336 to 7317308611462787072. Current Snapshot: MvccSnapshot[applied={T|T < 7317308611589902336}]
I20260811 12:44:57.782691 20786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:44:57.783010 20786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:44:57.787492 20786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 292f160ea55c4927ae6143031cf356a4: Sending DeleteTablet for 3 replicas of tablet 731ab6bf7379468bb164b6cafd56e709
I20260811 12:44:57.788693 21219 tablet_service.cc:1514] Processing DeleteTablet for tablet 731ab6bf7379468bb164b6cafd56e709 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:44:57 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:47216
I20260811 12:44:57.788908 20921 tablet_service.cc:1514] Processing DeleteTablet for tablet 731ab6bf7379468bb164b6cafd56e709 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:44:57 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:39818
I20260811 12:44:57.789343 21072 tablet_service.cc:1514] Processing DeleteTablet for tablet 731ab6bf7379468bb164b6cafd56e709 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:44:57 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:52372
I20260811 12:44:57.792778 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 20853
I20260811 12:44:57.799104 21346 tablet_replica.cc:330] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: stopping tablet replica
I20260811 12:44:57.799679 21346 raft_consensus.cc:2229] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:44:57.800436 21346 raft_consensus.cc:2258] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:44:57.805352 21346 ts_tablet_manager.cc:1905] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:44:57.808991 21344 tablet_replica.cc:330] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: stopping tablet replica
I20260811 12:44:57.809437 21344 raft_consensus.cc:2229] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:44:57.809973 21344 raft_consensus.cc:2258] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:44:57.812860 21345 tablet_replica.cc:330] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: stopping tablet replica
I20260811 12:44:57.813320 21345 raft_consensus.cc:2229] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 11 12:44:57 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:44:57.813884 21345 raft_consensus.cc:2258] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:44:57.815241 21344 ts_tablet_manager.cc:1905] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:44:57.818533 21345 ts_tablet_manager.cc:1905] T 731ab6bf7379468bb164b6cafd56e709 P 39a042b64bdc498589d74aa27ad47563: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:44:57.822909 21344 ts_tablet_manager.cc:1918] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:44:57.823081 21315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.794623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39828 (local address 127.0.186.65:44123)
0811 12:44:57.794865 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.794873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.797687 (+ 2814us) server_negotiation.cc:407] Connection header received
0811 12:44:57.797789 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.797798 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.797972 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.798099 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:57.801438 (+ 3339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.803122 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.806128 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.807096 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.807231 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.814806 (+ 7575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:57.814827 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:57.814844 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:57.814890 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:57.819113 (+ 4223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.820146 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.820156 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.820161 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.820369 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.820923 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.820928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.820931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.821414 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:57.821747 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.822368 (+ 621us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.822657 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:44:57.823727 21344 log.cc:1196] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/731ab6bf7379468bb164b6cafd56e709
I20260811 12:44:57.824290 21346 ts_tablet_manager.cc:1918] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:44:57.824523 21346 log.cc:1196] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/731ab6bf7379468bb164b6cafd56e709
I20260811 12:44:57.824746 20992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:57.824844 21344 ts_tablet_manager.cc:1939] T 731ab6bf7379468bb164b6cafd56e709 P 1133391f48ba40468984d06065097027: Deleting consensus metadata
I20260811 12:44:57.825196 21346 ts_tablet_manager.cc:1939] T 731ab6bf7379468bb164b6cafd56e709 P abe0925ef594429dbab70bea992e2667: Deleting consensus metadata
I20260811 12:44:57.826723 20772 catalog_manager.cc:4841] TS 1133391f48ba40468984d06065097027 (127.0.186.67:38295): tablet 731ab6bf7379468bb164b6cafd56e709 (table test-table [id=c09ce27933be4153ad888eac98131199]) successfully deleted
I20260811 12:44:57.827344 20770 catalog_manager.cc:4841] TS abe0925ef594429dbab70bea992e2667 (127.0.186.66:46413): tablet 731ab6bf7379468bb164b6cafd56e709 (table test-table [id=c09ce27933be4153ad888eac98131199]) successfully deleted
I20260811 12:44:57.926954 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 20853
I20260811 12:44:57.958966 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21004
W20260811 12:44:57.959036 20772 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.186.65:44123 (error 108)
I20260811 12:44:57.961376 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.960885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39836)
0811 12:44:57.961059 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:57.961201 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 12:44:57.961706 20772 catalog_manager.cc:4584] TS 39a042b64bdc498589d74aa27ad47563 (127.0.186.65:44123): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 731ab6bf7379468bb164b6cafd56e709: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Aug 11 12:44:57 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:44:57.980953 21313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:57.960323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52396 (local address 127.0.186.66:46413)
0811 12:44:57.960537 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:57.960544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:57.960567 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:44:57.961269 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:57.961275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:57.961376 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:57.961494 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:57.963513 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.964498 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.966707 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:57.967523 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:57.967673 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:57.973713 (+ 6040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:57.973730 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:57.973746 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:57.973798 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:57.977640 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.978712 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.978721 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.978723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.978884 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:57.979325 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:57.979328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:57.979330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:57.979736 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:57.979991 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:57.980350 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 12:44:57.980527 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:44:57.981777 21138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:58.015691 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.015173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39850)
0811 12:44:58.015399 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.015519 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 12:44:58.016842 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.016402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39862)
0811 12:44:58.016586 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.016666 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 12:44:58.077677 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.077067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39864)
0811 12:44:58.077311 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.077462 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 12:44:58.079041 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.078596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39866)
0811 12:44:58.078789 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.078888 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 12:44:58.104178 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21004
I20260811 12:44:58.130811 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21150
Aug 11 12:44:58 dist-test-slave-qg60 krb5kdc[20735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:44:58.155750 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.131684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.0.186.67:38295)
0811 12:44:58.131875 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:58.131880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:58.131899 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:44:58.132097 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:58.132101 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:58.132179 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:58.132265 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:58.133772 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:58.134520 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:58.135842 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:58.136253 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:58.136359 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:58.149459 (+ 13100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:58.149480 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:58.149496 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:44:58.149544 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:58.152454 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:58.153316 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:58.153325 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:58.153327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:58.153509 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:44:58.153951 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:44:58.153956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:44:58.153960 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:44:58.154397 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:58.154675 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:58.155064 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 12:44:58.155270 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:44:58.156493 21289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:58.159859 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.159208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39882)
0811 12:44:58.159503 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.159637 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 12:44:58.161439 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.160841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39890)
0811 12:44:58.161122 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.161232 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260811 12:44:58.252846 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21150
I20260811 12:44:58.276827 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 20748
I20260811 12:44:58.278332 20819 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:44:58.396912 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:58.395900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44123 (local address 127.0.0.1:39906)
0811 12:44:58.396122 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:58.396439 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 12:44:58.397189 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 20748
2026-08-11T12:44:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5028 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T12:44:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:44:58Z Disabled control of system clock
I20260811 12:44:58.511868 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:38457
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:38457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 12:44:58.884979 21358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:58.885305 21358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:58.885462 21358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:58.893127 21358 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:44:58.893251 21358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:58.893353 21358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:58.893469 21358 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:44:58.893556 21358 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:44:58.909094 21358 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:38457
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:38457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:58.911195 21358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:58.913892 21358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:58.928537 21364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:58.928850 21363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:58.928828 21367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:58.929927 21358 server_base.cc:1034] running on GCE node
I20260811 12:44:58.931054 21358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:58.932844 21358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:58.934193 21358 hybrid_clock.cc:648] HybridClock initialized: now 1786452298934142 us; error 50 us; skew 500 ppm
I20260811 12:44:58.934659 21358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:44:58.937750 21358 webserver.cc:460] Webserver started at http://127.0.186.126:33229/ using document root <none> and password file <none>
I20260811 12:44:58.938575 21358 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:58.938733 21358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:58.939195 21358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:44:58.942642 21358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "a00236978cae4902a3a791aa4977e6f3"
format_stamp: "Formatted at 2026-08-11 12:44:58 on dist-test-slave-qg60"
server_key: "c2036648c7d2b75d62a805ebb7e723b5"
server_key_iv: "dfa69346969e33b5b087e984faf4059a"
server_key_version: "encryptionkey@0"
I20260811 12:44:58.943524 21358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "a00236978cae4902a3a791aa4977e6f3"
format_stamp: "Formatted at 2026-08-11 12:44:58 on dist-test-slave-qg60"
server_key: "c2036648c7d2b75d62a805ebb7e723b5"
server_key_iv: "dfa69346969e33b5b087e984faf4059a"
server_key_version: "encryptionkey@0"
I20260811 12:44:58.949380 21358 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260811 12:44:58.953404 21373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:58.955204 21358 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 12:44:58.955437 21358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "a00236978cae4902a3a791aa4977e6f3"
format_stamp: "Formatted at 2026-08-11 12:44:58 on dist-test-slave-qg60"
server_key: "c2036648c7d2b75d62a805ebb7e723b5"
server_key_iv: "dfa69346969e33b5b087e984faf4059a"
server_key_version: "encryptionkey@0"
I20260811 12:44:58.955729 21358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:58.978262 21358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:58.979274 21358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:58.979622 21358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:59.001291 21358 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:38457
I20260811 12:44:59.001310 21429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:38457 every 8 connection(s)
I20260811 12:44:59.002810 21358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:44:59.005277 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21358
I20260811 12:44:59.005491 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:44:59.006086 745 external_mini_cluster.cc:1428] Setting key e8294c62edf89d7748822fc19dcd099f
I20260811 12:44:59.008018 21430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:44:59.020925 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:59.008367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45424 (local address 127.0.186.126:38457)
0811 12:44:59.009560 (+ 1193us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:59.009574 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:59.009620 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:44:59.011343 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:59.011368 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:59.011887 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:59.012353 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:59.012983 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:59.014418 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:59.015968 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:59.016678 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:59.016959 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:59.018300 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:59.018312 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:59.018327 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:44:59.018972 (+ 645us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:59.019066 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:44:59.019088 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:59.019223 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:59.019468 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 12:44:59.019821 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":460,"threads_started":1}
I20260811 12:44:59.021238 21430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3: Bootstrap starting.
I20260811 12:44:59.024838 21430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3: Neither blocks nor log segments found. Creating new log.
I20260811 12:44:59.025918 21430 log.cc:824] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3: Log is configured to *not* fsync() on all Append() calls
I20260811 12:44:59.029240 21430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3: No bootstrap required, opened a new log
I20260811 12:44:59.037508 21430 raft_consensus.cc:348] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a00236978cae4902a3a791aa4977e6f3" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38457 } }
I20260811 12:44:59.037972 21430 raft_consensus.cc:374] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:44:59.038091 21430 raft_consensus.cc:729] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00236978cae4902a3a791aa4977e6f3, State: Initialized, Role: FOLLOWER
I20260811 12:44:59.038767 21430 consensus_queue.cc:260] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a00236978cae4902a3a791aa4977e6f3" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38457 } }
I20260811 12:44:59.039036 21430 raft_consensus.cc:388] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:44:59.039207 21430 raft_consensus.cc:482] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:44:59.039391 21430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:44:59.041888 21430 raft_consensus.cc:504] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a00236978cae4902a3a791aa4977e6f3" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38457 } }
I20260811 12:44:59.042568 21430 leader_election.cc:302] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a00236978cae4902a3a791aa4977e6f3; no voters:
I20260811 12:44:59.043308 21430 leader_election.cc:288] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:44:59.043560 21435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:44:59.044493 21435 raft_consensus.cc:686] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [term 1 LEADER]: Becoming Leader. State: Replica: a00236978cae4902a3a791aa4977e6f3, State: Running, Role: LEADER
I20260811 12:44:59.045125 21435 consensus_queue.cc:237] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a00236978cae4902a3a791aa4977e6f3" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38457 } }
I20260811 12:44:59.045662 21430 sys_catalog.cc:564] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:44:59.047910 21436 sys_catalog.cc:455] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a00236978cae4902a3a791aa4977e6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a00236978cae4902a3a791aa4977e6f3" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38457 } } }
I20260811 12:44:59.048285 21436 sys_catalog.cc:458] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:59.050069 21437 sys_catalog.cc:455] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a00236978cae4902a3a791aa4977e6f3. Latest consensus state: current_term: 1 leader_uuid: "a00236978cae4902a3a791aa4977e6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a00236978cae4902a3a791aa4977e6f3" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 38457 } } }
I20260811 12:44:59.050535 21437 sys_catalog.cc:458] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3 [sys.catalog]: This master's current role is: LEADER
I20260811 12:44:59.052001 21441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:44:59.057775 21441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:44:59.067535 21441 catalog_manager.cc:1347] Generated new cluster ID: 864c69a3db68490aaf1303cd495b59c7
I20260811 12:44:59.067658 21441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:44:59.085445 21441 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:44:59.086906 21441 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:44:59.099390 21441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3: Generated new TSK 0
I20260811 12:44:59.100440 21441 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:44:59.109885 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38457
--builtin_ntp_servers=127.0.186.84:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 12:44:59.503706 21455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:44:59.504029 21455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:44:59.504129 21455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:44:59.511596 21455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:44:59.511725 21455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:44:59.511837 21455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:44:59.521657 21455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:44:59.523129 21455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:44:59.524977 21455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:44:59.539345 21461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:59.539834 21464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:44:59.539875 21462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:44:59.540819 21455 server_base.cc:1034] running on GCE node
I20260811 12:44:59.541569 21455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:44:59.542985 21455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:44:59.544282 21455 hybrid_clock.cc:648] HybridClock initialized: now 1786452299544216 us; error 51 us; skew 500 ppm
I20260811 12:44:59.544672 21455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:44:59.547659 21455 webserver.cc:460] Webserver started at http://127.0.186.65:42207/ using document root <none> and password file <none>
I20260811 12:44:59.548410 21455 fs_manager.cc:359] Metadata directory not provided
I20260811 12:44:59.548528 21455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:44:59.548955 21455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:44:59.551951 21455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "3488f9dc5740403392cec0f2ead30f4d"
format_stamp: "Formatted at 2026-08-11 12:44:59 on dist-test-slave-qg60"
server_key: "cca68920a1a8e3ec168221fafcfeaad7"
server_key_iv: "96286350e6876b5c45b7643ed58e4cb0"
server_key_version: "encryptionkey@0"
I20260811 12:44:59.552922 21455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "3488f9dc5740403392cec0f2ead30f4d"
format_stamp: "Formatted at 2026-08-11 12:44:59 on dist-test-slave-qg60"
server_key: "cca68920a1a8e3ec168221fafcfeaad7"
server_key_iv: "96286350e6876b5c45b7643ed58e4cb0"
server_key_version: "encryptionkey@0"
I20260811 12:44:59.558558 21455 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 12:44:59.562577 21472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:59.563999 21455 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:44:59.564194 21455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "3488f9dc5740403392cec0f2ead30f4d"
format_stamp: "Formatted at 2026-08-11 12:44:59 on dist-test-slave-qg60"
server_key: "cca68920a1a8e3ec168221fafcfeaad7"
server_key_iv: "96286350e6876b5c45b7643ed58e4cb0"
server_key_version: "encryptionkey@0"
I20260811 12:44:59.564431 21455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:44:59.607900 21455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:44:59.608940 21455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:44:59.609279 21455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:44:59.610392 21455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:44:59.612063 21455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:44:59.612210 21455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:59.612341 21455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:44:59.612430 21455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:44:59.650254 21455 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:44185
I20260811 12:44:59.650353 21597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:44185 every 8 connection(s)
I20260811 12:44:59.651674 21455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:44:59.655332 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21455
I20260811 12:44:59.655521 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:44:59.656217 745 external_mini_cluster.cc:1428] Setting key e68ca30a8b82c9c63ca80bd0d6d480fd
I20260811 12:44:59.659750 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38457
--builtin_ntp_servers=127.0.186.84:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 12:44:59.668442 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:59.654682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:33811 (local address 127.0.186.126:38457)
0811 12:44:59.655173 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 12:44:59.655179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:44:59.656835 (+ 1656us) server_negotiation.cc:407] Connection header received
0811 12:44:59.659243 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:44:59.659248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:44:59.659332 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:44:59.659509 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:44:59.661165 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:59.662090 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:59.664830 (+ 2740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:44:59.665327 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:44:59.665447 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:59.667316 (+ 1869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:44:59.667321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:44:59.667325 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:44:59.667347 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:44:59.667394 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:44:59.667407 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:44:59.667489 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 12:44:59.667879 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 12:44:59.667976 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":234,"threads_started":1}
I20260811 12:44:59.669880 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:44:59.655324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38457 (local address 127.0.186.65:33811)
0811 12:44:59.656519 (+ 1195us) negotiation.cc:107] Waiting for socket to connect
0811 12:44:59.656579 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 12:44:59.658764 (+ 2185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:44:59.659837 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:44:59.659851 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:44:59.660005 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:44:59.660939 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:59.660971 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:59.662303 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:59.662312 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:59.664565 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:44:59.664594 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:44:59.665608 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:44:59.665620 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:44:59.665974 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:44:59.666871 (+ 897us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:44:59.666877 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:44:59.666943 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:44:59.667068 (+ 125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:44:59.667517 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:44:59.667531 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:44:59.667542 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 12:44:59.667799 (+ 257us) client_negotiation.cc:240] Negotiation successful
0811 12:44:59.668266 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":376,"threads_started":1}
I20260811 12:44:59.671712 21598 heartbeater.cc:347] Connected to a master server at 127.0.186.126:38457
I20260811 12:44:59.672118 21598 heartbeater.cc:464] Registering TS with master...
I20260811 12:44:59.673022 21598 heartbeater.cc:511] Master 127.0.186.126:38457 requested a full tablet report, sending...
I20260811 12:44:59.675371 21391 ts_manager.cc:194] Registered new tserver with Master: 3488f9dc5740403392cec0f2ead30f4d (127.0.186.65:44185)
I20260811 12:44:59.677188 21391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.65:33811
W20260811 12:45:00.029187 21603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:00.029495 21603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:00.029589 21603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:00.037288 21603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:00.037408 21603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:00.037519 21603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:45:00.047242 21603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:00.048714 21603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:00.050717 21603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:00.065716 21608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:00.065621 21609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:00.066520 21612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:00.066752 21603 server_base.cc:1034] running on GCE node
I20260811 12:45:00.067509 21603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:00.068621 21603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:00.069887 21603 hybrid_clock.cc:648] HybridClock initialized: now 1786452300069819 us; error 51 us; skew 500 ppm
I20260811 12:45:00.070298 21603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:00.073035 21603 webserver.cc:460] Webserver started at http://127.0.186.66:37333/ using document root <none> and password file <none>
I20260811 12:45:00.073844 21603 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:00.074000 21603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:00.074368 21603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:00.078229 21603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "712f8e8e50b744d38bc4ccb13f1b92e9"
format_stamp: "Formatted at 2026-08-11 12:45:00 on dist-test-slave-qg60"
server_key: "d47141118b60f76286398460d6999691"
server_key_iv: "16b31038b98f96e4be6f0254798eed34"
server_key_version: "encryptionkey@0"
I20260811 12:45:00.079165 21603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "712f8e8e50b744d38bc4ccb13f1b92e9"
format_stamp: "Formatted at 2026-08-11 12:45:00 on dist-test-slave-qg60"
server_key: "d47141118b60f76286398460d6999691"
server_key_iv: "16b31038b98f96e4be6f0254798eed34"
server_key_version: "encryptionkey@0"
I20260811 12:45:00.085158 21603 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 12:45:00.089210 21620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:00.090721 21603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:00.090937 21603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "712f8e8e50b744d38bc4ccb13f1b92e9"
format_stamp: "Formatted at 2026-08-11 12:45:00 on dist-test-slave-qg60"
server_key: "d47141118b60f76286398460d6999691"
server_key_iv: "16b31038b98f96e4be6f0254798eed34"
server_key_version: "encryptionkey@0"
I20260811 12:45:00.091195 21603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:00.107975 21603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:00.108994 21603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:00.109349 21603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:00.110419 21603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:00.112082 21603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:00.112215 21603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:00.112347 21603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:00.112439 21603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:00.149287 21603 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:44681
I20260811 12:45:00.149351 21746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:44681 every 8 connection(s)
I20260811 12:45:00.150729 21603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:45:00.160568 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21603
I20260811 12:45:00.160812 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:45:00.161369 745 external_mini_cluster.cc:1428] Setting key fe5b6b3ba14add48ac13ae4afcb3bcbb
I20260811 12:45:00.164705 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38457
--builtin_ntp_servers=127.0.186.84:38115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 12:45:00.164872 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.153758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:60375 (local address 127.0.186.126:38457)
0811 12:45:00.153999 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:00.154006 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:00.155583 (+ 1577us) server_negotiation.cc:407] Connection header received
0811 12:45:00.157579 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:00.157584 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:00.157657 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:00.157752 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:00.158903 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.159668 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.161636 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.162198 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.162357 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.163987 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:00.163993 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:00.163997 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:00.164017 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:00.164053 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:00.164066 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:00.164141 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:00.164434 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 12:45:00.164522 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:45:00.166509 21749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.154500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38457 (local address 127.0.186.66:60375)
0811 12:45:00.155415 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:00.155457 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:00.157298 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:00.158035 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:00.158044 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:00.158135 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:00.158738 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.158755 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.159817 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.159821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.161449 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.161486 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.162459 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.162467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.162715 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.163515 (+ 800us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:00.163519 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:00.163582 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:00.163697 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:00.164181 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:00.164193 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:00.164201 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 12:45:00.164423 (+ 222us) client_negotiation.cc:240] Negotiation successful
0811 12:45:00.164960 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":301,"threads_started":1}
I20260811 12:45:00.168255 21747 heartbeater.cc:347] Connected to a master server at 127.0.186.126:38457
I20260811 12:45:00.168681 21747 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:00.169761 21747 heartbeater.cc:511] Master 127.0.186.126:38457 requested a full tablet report, sending...
I20260811 12:45:00.171587 21391 ts_manager.cc:194] Registered new tserver with Master: 712f8e8e50b744d38bc4ccb13f1b92e9 (127.0.186.66:44681)
I20260811 12:45:00.172499 21391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.66:60375
W20260811 12:45:00.533342 21750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:00.533643 21750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:00.533797 21750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:00.541957 21750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:00.542076 21750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:00.542248 21750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:45:00.552239 21750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:38457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:00.553772 21750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:00.555637 21750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:00.570389 21755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:00.570633 21758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:00.570633 21756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:00.571861 21750 server_base.cc:1034] running on GCE node
I20260811 12:45:00.572533 21750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:00.573746 21750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:00.575032 21750 hybrid_clock.cc:648] HybridClock initialized: now 1786452300574942 us; error 41 us; skew 500 ppm
I20260811 12:45:00.575403 21750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:00.578258 21750 webserver.cc:460] Webserver started at http://127.0.186.67:33961/ using document root <none> and password file <none>
I20260811 12:45:00.579044 21750 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:00.579169 21750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:00.579540 21750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:00.582870 21750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "6cf5c12cd475440987b89dc2a439025a"
format_stamp: "Formatted at 2026-08-11 12:45:00 on dist-test-slave-qg60"
server_key: "8a57614d5b2801336f575a54ff0e66bc"
server_key_iv: "435addee454f9718ba1e29f9307c3702"
server_key_version: "encryptionkey@0"
I20260811 12:45:00.583786 21750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "6cf5c12cd475440987b89dc2a439025a"
format_stamp: "Formatted at 2026-08-11 12:45:00 on dist-test-slave-qg60"
server_key: "8a57614d5b2801336f575a54ff0e66bc"
server_key_iv: "435addee454f9718ba1e29f9307c3702"
server_key_version: "encryptionkey@0"
I20260811 12:45:00.589512 21750 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:45:00.593375 21764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:00.595079 21750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:45:00.595281 21750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "6cf5c12cd475440987b89dc2a439025a"
format_stamp: "Formatted at 2026-08-11 12:45:00 on dist-test-slave-qg60"
server_key: "8a57614d5b2801336f575a54ff0e66bc"
server_key_iv: "435addee454f9718ba1e29f9307c3702"
server_key_version: "encryptionkey@0"
I20260811 12:45:00.595530 21750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:00.621255 21750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:00.622331 21750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:00.622694 21750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:00.623890 21750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:00.625671 21750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:00.625808 21750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:00.625967 21750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:00.626066 21750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:00.664542 21750 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:46643
I20260811 12:45:00.664764 21893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:46643 every 8 connection(s)
I20260811 12:45:00.666154 21750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:45:00.673485 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21750
I20260811 12:45:00.673697 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:45:00.674185 745 external_mini_cluster.cc:1428] Setting key a07d4b6771022b19457d707ed5244c96
I20260811 12:45:00.680354 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.669512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:52823 (local address 127.0.186.126:38457)
0811 12:45:00.670010 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:00.670021 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:00.671096 (+ 1075us) server_negotiation.cc:407] Connection header received
0811 12:45:00.673185 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:00.673191 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:00.673293 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:00.673418 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:00.674562 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.675547 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.677508 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.677907 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.678048 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.679415 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:00.679420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:00.679423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:00.679441 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:00.679483 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:00.679495 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:00.679593 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:00.679851 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 12:45:00.679952 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":282,"threads_started":1}
I20260811 12:45:00.680853 21598 heartbeater.cc:503] Master 127.0.186.126:38457 was elected leader, sending a full tablet report...
I20260811 12:45:00.681699 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.669998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:38457 (local address 127.0.186.67:52823)
0811 12:45:00.670931 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:00.670973 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:00.672824 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:00.673664 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:00.673672 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:00.673813 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:00.674388 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.674405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.675713 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.675717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.677354 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.677367 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.678148 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.678157 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.678391 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.679082 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:00.679085 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:00.679128 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:00.679213 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:00.679594 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:00.679643 (+ 49us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:00.679651 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 12:45:00.679837 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 12:45:00.680258 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":287,"threads_started":1}
I20260811 12:45:00.683197 21894 heartbeater.cc:347] Connected to a master server at 127.0.186.126:38457
I20260811 12:45:00.683471 21894 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:00.684216 21894 heartbeater.cc:511] Master 127.0.186.126:38457 requested a full tablet report, sending...
I20260811 12:45:00.685829 21390 ts_manager.cc:194] Registered new tserver with Master: 6cf5c12cd475440987b89dc2a439025a (127.0.186.67:46643)
I20260811 12:45:00.686859 21390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.67:52823
I20260811 12:45:00.690124 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:45:00.701329 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.694704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45430 (local address 127.0.186.126:38457)
0811 12:45:00.694914 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:00.694921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:00.695323 (+ 402us) server_negotiation.cc:407] Connection header received
0811 12:45:00.695426 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:00.695429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:00.695581 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:00.695678 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:00.696202 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.697121 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.698591 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.699153 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.699261 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.700638 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:00.700642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:00.700646 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:00.700667 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:00.700754 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:00.700767 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:00.700840 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:00.700979 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 12:45:00.701077 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 12:45:00.706099 21390 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45430:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:45:00.714172 21390 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:45:00.763515 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.729071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.0.186.67:46643)
0811 12:45:00.755348 (+ 26277us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:00.755359 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:00.755400 (+ 41us) server_negotiation.cc:407] Connection header received
0811 12:45:00.755526 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:00.755536 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:00.755787 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:00.756012 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:00.756677 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.758210 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.760835 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.762164 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.762325 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.762628 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:00.762876 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 12:45:00.763050 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26071,"thread_start_us":25876,"threads_started":1}
I20260811 12:45:00.764212 21909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.728520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:44681 (local address 127.0.0.1:59002)
0811 12:45:00.746595 (+ 18075us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:00.746626 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:00.746807 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:00.754800 (+ 7993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:00.754840 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:00.754887 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:00.755380 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.755392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.757982 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.758005 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.761133 (+ 3128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.761151 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.763301 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.763308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.763521 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.763561 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 12:45:00.763639 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 12:45:00.763786 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17866,"mutex_wait_us":26,"thread_start_us":11778,"threads_started":1}
I20260811 12:45:00.764391 21908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.728464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:46643 (local address 127.0.0.1:51252)
0811 12:45:00.740937 (+ 12473us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:00.741026 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:00.741323 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:00.756024 (+ 14701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:00.756028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:00.756053 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:00.756433 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.756447 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.758361 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.758369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.760531 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.760543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.762370 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.762376 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.762592 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.762655 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 12:45:00.762811 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 12:45:00.763016 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12033,"mutex_wait_us":60,"thread_start_us":17719,"threads_started":1}
I20260811 12:45:00.765445 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.730627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:44185 (local address 127.0.0.1:37014)
0811 12:45:00.752320 (+ 21693us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:00.752345 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:00.752522 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:00.754735 (+ 2213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:00.754747 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:00.754805 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:00.755501 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.755517 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.757675 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.757683 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.761808 (+ 4125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:00.761823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.764513 (+ 2690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.764523 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:00.764859 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.764892 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 12:45:00.764995 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 12:45:00.765125 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21536,"mutex_wait_us":248,"thread_start_us":21329,"threads_started":1}
I20260811 12:45:00.765731 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.731505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37014 (local address 127.0.186.65:44185)
0811 12:45:00.753358 (+ 21853us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:00.753381 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:00.753420 (+ 39us) server_negotiation.cc:407] Connection header received
0811 12:45:00.753552 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:00.753560 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:00.753811 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:00.754357 (+ 546us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:00.755722 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.757498 (+ 1776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.762068 (+ 4570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.763862 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.763999 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.764328 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:00.765071 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 12:45:00.765266 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21637,"thread_start_us":22461,"threads_started":1}
I20260811 12:45:00.765733 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:00.729060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59002 (local address 127.0.186.66:44681)
0811 12:45:00.752259 (+ 23199us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:00.752270 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:00.752314 (+ 44us) server_negotiation.cc:407] Connection header received
0811 12:45:00.752462 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:00.752471 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:00.754383 (+ 1912us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:00.755589 (+ 1206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:00.755763 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.757816 (+ 2053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.761399 (+ 3583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:00.763045 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:00.764792 (+ 1747us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:00.765083 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:00.765167 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 12:45:00.765330 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21295,"thread_start_us":22240,"threads_started":1}
I20260811 12:45:00.769094 21816 tablet_service.cc:1467] Processing CreateTablet for tablet caf5a92e0ddb4f05b02e90c053f906f2 (DEFAULT_TABLE table=test-table [id=56ed98d96ad741e8b98d6c7afc6ea4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:00.771024 21816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf5a92e0ddb4f05b02e90c053f906f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:00.772015 21526 tablet_service.cc:1467] Processing CreateTablet for tablet caf5a92e0ddb4f05b02e90c053f906f2 (DEFAULT_TABLE table=test-table [id=56ed98d96ad741e8b98d6c7afc6ea4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:00.772323 21674 tablet_service.cc:1467] Processing CreateTablet for tablet caf5a92e0ddb4f05b02e90c053f906f2 (DEFAULT_TABLE table=test-table [id=56ed98d96ad741e8b98d6c7afc6ea4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:00.773660 21526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf5a92e0ddb4f05b02e90c053f906f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:00.774384 21674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf5a92e0ddb4f05b02e90c053f906f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:00.785543 21914 tablet_bootstrap.cc:492] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Bootstrap starting.
I20260811 12:45:00.788393 21915 tablet_bootstrap.cc:492] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Bootstrap starting.
I20260811 12:45:00.790211 21914 tablet_bootstrap.cc:654] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:00.791815 21914 log.cc:824] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:00.792208 21917 tablet_bootstrap.cc:492] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Bootstrap starting.
I20260811 12:45:00.792251 21915 tablet_bootstrap.cc:654] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:00.793656 21915 log.cc:824] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:00.796276 21914 tablet_bootstrap.cc:492] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: No bootstrap required, opened a new log
I20260811 12:45:00.796590 21914 ts_tablet_manager.cc:1397] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260811 12:45:00.797812 21917 tablet_bootstrap.cc:654] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:00.799386 21917 log.cc:824] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:00.802175 21915 tablet_bootstrap.cc:492] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: No bootstrap required, opened a new log
I20260811 12:45:00.802485 21915 ts_tablet_manager.cc:1397] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260811 12:45:00.807199 21917 tablet_bootstrap.cc:492] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: No bootstrap required, opened a new log
I20260811 12:45:00.807538 21917 ts_tablet_manager.cc:1397] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.000s
I20260811 12:45:00.808169 21914 raft_consensus.cc:348] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:00.808681 21914 raft_consensus.cc:374] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:00.808809 21914 raft_consensus.cc:729] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3488f9dc5740403392cec0f2ead30f4d, State: Initialized, Role: FOLLOWER
I20260811 12:45:00.809523 21914 consensus_queue.cc:260] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:00.814404 21914 ts_tablet_manager.cc:1428] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Time spent starting tablet: real 0.018s user 0.016s sys 0.001s
I20260811 12:45:00.814383 21915 raft_consensus.cc:348] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:00.814898 21915 raft_consensus.cc:374] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:00.815024 21915 raft_consensus.cc:729] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf5c12cd475440987b89dc2a439025a, State: Initialized, Role: FOLLOWER
I20260811 12:45:00.815724 21915 consensus_queue.cc:260] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:00.817421 21894 heartbeater.cc:503] Master 127.0.186.126:38457 was elected leader, sending a full tablet report...
I20260811 12:45:00.818220 21915 ts_tablet_manager.cc:1428] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Time spent starting tablet: real 0.016s user 0.006s sys 0.010s
I20260811 12:45:00.818146 21917 raft_consensus.cc:348] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:00.818660 21917 raft_consensus.cc:374] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:00.818794 21917 raft_consensus.cc:729] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712f8e8e50b744d38bc4ccb13f1b92e9, State: Initialized, Role: FOLLOWER
I20260811 12:45:00.819653 21917 consensus_queue.cc:260] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:00.821391 21747 heartbeater.cc:503] Master 127.0.186.126:38457 was elected leader, sending a full tablet report...
I20260811 12:45:00.822046 21917 ts_tablet_manager.cc:1428] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
W20260811 12:45:00.903285 21748 tablet.cc:2369] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:00.904392 21600 tablet.cc:2369] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:00.918205 21896 tablet.cc:2369] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:45:01.184188 21921 raft_consensus.cc:482] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:45:01.184607 21921 raft_consensus.cc:504] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:01.186740 21921 leader_election.cc:288] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf5c12cd475440987b89dc2a439025a (127.0.186.67:46643), 712f8e8e50b744d38bc4ccb13f1b92e9 (127.0.186.66:44681)
I20260811 12:45:01.194253 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.187181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:37009 (local address 127.0.186.67:46643)
0811 12:45:01.187428 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:01.187435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:01.188384 (+ 949us) server_negotiation.cc:407] Connection header received
0811 12:45:01.188634 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:01.188638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:01.188704 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:01.188846 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:01.189486 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.190220 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.192383 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.193296 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.193492 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.193569 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:01.193856 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 12:45:01.193999 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:45:01.194412 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.187180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:46643 (local address 127.0.186.65:37009)
0811 12:45:01.188239 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:01.188264 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:01.188478 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:01.188874 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:01.188879 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:01.188916 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:01.189317 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:01.189331 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.190358 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.190364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:01.192181 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:01.192198 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.193506 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.193512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:01.193682 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.193707 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 12:45:01.193826 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 12:45:01.193964 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"mutex_wait_us":74,"thread_start_us":572,"threads_started":1}
I20260811 12:45:01.194854 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.187537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:57177 (local address 127.0.186.66:44681)
0811 12:45:01.187813 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:01.187820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:01.188545 (+ 725us) server_negotiation.cc:407] Connection header received
0811 12:45:01.188798 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:01.188803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:01.188884 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:01.189013 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:01.189711 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.190496 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.192924 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.193801 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.194020 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.194098 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:01.194417 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 12:45:01.194575 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 12:45:01.195019 21926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.187396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:44681 (local address 127.0.186.65:57177)
0811 12:45:01.188396 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:01.188416 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:01.188600 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:01.189073 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:01.189078 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:01.189112 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:01.189535 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:01.189544 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.190662 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.190679 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:01.192590 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:01.192604 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.194034 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.194041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:01.194221 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.194257 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 12:45:01.194383 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 12:45:01.194537 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":888,"mutex_wait_us":61,"thread_start_us":647,"threads_started":1}
I20260811 12:45:01.195873 21839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf5a92e0ddb4f05b02e90c053f906f2" candidate_uuid: "3488f9dc5740403392cec0f2ead30f4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf5c12cd475440987b89dc2a439025a" is_pre_election: true
I20260811 12:45:01.196220 21694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf5a92e0ddb4f05b02e90c053f906f2" candidate_uuid: "3488f9dc5740403392cec0f2ead30f4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" is_pre_election: true
I20260811 12:45:01.196410 21839 raft_consensus.cc:2454] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3488f9dc5740403392cec0f2ead30f4d in term 0.
I20260811 12:45:01.196913 21694 raft_consensus.cc:2454] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3488f9dc5740403392cec0f2ead30f4d in term 0.
I20260811 12:45:01.197415 21475 leader_election.cc:302] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3488f9dc5740403392cec0f2ead30f4d, 6cf5c12cd475440987b89dc2a439025a; no voters:
I20260811 12:45:01.197956 21921 raft_consensus.cc:2781] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:45:01.198138 21921 raft_consensus.cc:482] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:45:01.198254 21921 raft_consensus.cc:3037] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:01.200804 21921 raft_consensus.cc:504] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:01.201575 21921 leader_election.cc:288] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [CANDIDATE]: Term 1 election: Requested vote from peers 6cf5c12cd475440987b89dc2a439025a (127.0.186.67:46643), 712f8e8e50b744d38bc4ccb13f1b92e9 (127.0.186.66:44681)
I20260811 12:45:01.202359 21694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf5a92e0ddb4f05b02e90c053f906f2" candidate_uuid: "3488f9dc5740403392cec0f2ead30f4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9"
I20260811 12:45:01.202458 21839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf5a92e0ddb4f05b02e90c053f906f2" candidate_uuid: "3488f9dc5740403392cec0f2ead30f4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf5c12cd475440987b89dc2a439025a"
I20260811 12:45:01.202593 21694 raft_consensus.cc:3037] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:01.202764 21839 raft_consensus.cc:3037] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:01.205224 21694 raft_consensus.cc:2454] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3488f9dc5740403392cec0f2ead30f4d in term 1.
I20260811 12:45:01.205678 21839 raft_consensus.cc:2454] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3488f9dc5740403392cec0f2ead30f4d in term 1.
I20260811 12:45:01.205873 21476 leader_election.cc:302] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3488f9dc5740403392cec0f2ead30f4d, 712f8e8e50b744d38bc4ccb13f1b92e9; no voters:
I20260811 12:45:01.206295 21921 raft_consensus.cc:2781] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:01.206833 21921 raft_consensus.cc:686] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 1 LEADER]: Becoming Leader. State: Replica: 3488f9dc5740403392cec0f2ead30f4d, State: Running, Role: LEADER
I20260811 12:45:01.207504 21921 consensus_queue.cc:237] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } }
I20260811 12:45:01.213146 21390 catalog_manager.cc:5495] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3488f9dc5740403392cec0f2ead30f4d (127.0.186.65). New cstate: current_term: 1 leader_uuid: "3488f9dc5740403392cec0f2ead30f4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3488f9dc5740403392cec0f2ead30f4d" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 44185 } health_report { overall_health: HEALTHY } } }
I20260811 12:45:01.334753 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.327812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37022 (local address 127.0.186.65:44185)
0811 12:45:01.328365 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:01.328370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:01.328393 (+ 23us) server_negotiation.cc:407] Connection header received
0811 12:45:01.328710 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:01.328715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:01.328987 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:01.329173 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:45:01.329660 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.330520 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.332162 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.332641 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.332846 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.333522 (+ 676us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:45:01.334146 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:45:01.334289 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:01.334428 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 12:45:01.334505 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":311,"threads_started":1}
I20260811 12:45:01.343657 21694 raft_consensus.cc:1261] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 1 FOLLOWER]: Refusing update from remote peer 3488f9dc5740403392cec0f2ead30f4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:01.343657 21839 raft_consensus.cc:1261] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 1 FOLLOWER]: Refusing update from remote peer 3488f9dc5740403392cec0f2ead30f4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:01.344686 21927 consensus_queue.cc:1035] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf5c12cd475440987b89dc2a439025a" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 46643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:01.345114 21921 consensus_queue.cc:1035] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "712f8e8e50b744d38bc4ccb13f1b92e9" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:01.359238 21936 mvcc.cc:205] Tried to move back new op lower bound from 7317308626293116928 to 7317308625751003136. Current Snapshot: MvccSnapshot[applied={T|T < 7317308626293116928}]
I20260811 12:45:01.375885 21390 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:01.376173 21390 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:01.379995 21390 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a00236978cae4902a3a791aa4977e6f3: Sending DeleteTablet for 3 replicas of tablet caf5a92e0ddb4f05b02e90c053f906f2
I20260811 12:45:01.381342 21816 tablet_service.cc:1514] Processing DeleteTablet for tablet caf5a92e0ddb4f05b02e90c053f906f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:01 UTC) from {username='slave'} at 127.0.0.1:51252
I20260811 12:45:01.381469 21674 tablet_service.cc:1514] Processing DeleteTablet for tablet caf5a92e0ddb4f05b02e90c053f906f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:01 UTC) from {username='slave'} at 127.0.0.1:59002
I20260811 12:45:01.381789 21526 tablet_service.cc:1514] Processing DeleteTablet for tablet caf5a92e0ddb4f05b02e90c053f906f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:01 UTC) from {username='slave'} at 127.0.0.1:37014
I20260811 12:45:01.382759 21948 tablet_replica.cc:330] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: stopping tablet replica
I20260811 12:45:01.383386 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21455
I20260811 12:45:01.383424 21948 raft_consensus.cc:2229] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:01.384235 21948 raft_consensus.cc:2258] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:01.385388 21947 tablet_replica.cc:330] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: stopping tablet replica
I20260811 12:45:01.386035 21947 raft_consensus.cc:2229] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:01.386673 21947 raft_consensus.cc:2258] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:01.386698 21948 ts_tablet_manager.cc:1905] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:01.394939 21947 ts_tablet_manager.cc:1905] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:01.396306 21949 tablet_replica.cc:330] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: stopping tablet replica
I20260811 12:45:01.396901 21949 raft_consensus.cc:2229] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:45:01.397676 21949 raft_consensus.cc:2258] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:01.399976 21949 ts_tablet_manager.cc:1905] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:01.403343 21947 ts_tablet_manager.cc:1918] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:01.403517 21947 log.cc:1196] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/caf5a92e0ddb4f05b02e90c053f906f2
I20260811 12:45:01.404100 21947 ts_tablet_manager.cc:1939] T caf5a92e0ddb4f05b02e90c053f906f2 P 712f8e8e50b744d38bc4ccb13f1b92e9: Deleting consensus metadata
I20260811 12:45:01.405257 21948 ts_tablet_manager.cc:1918] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:01.405463 21948 log.cc:1196] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/caf5a92e0ddb4f05b02e90c053f906f2
I20260811 12:45:01.406031 21948 ts_tablet_manager.cc:1939] T caf5a92e0ddb4f05b02e90c053f906f2 P 6cf5c12cd475440987b89dc2a439025a: Deleting consensus metadata
I20260811 12:45:01.406271 21378 catalog_manager.cc:4841] TS 712f8e8e50b744d38bc4ccb13f1b92e9 (127.0.186.66:44681): tablet caf5a92e0ddb4f05b02e90c053f906f2 (table test-table [id=56ed98d96ad741e8b98d6c7afc6ea4fe]) successfully deleted
I20260811 12:45:01.407907 21377 catalog_manager.cc:4841] TS 6cf5c12cd475440987b89dc2a439025a (127.0.186.67:46643): tablet caf5a92e0ddb4f05b02e90c053f906f2 (table test-table [id=56ed98d96ad741e8b98d6c7afc6ea4fe]) successfully deleted
I20260811 12:45:01.408522 21949 ts_tablet_manager.cc:1918] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:01.408710 21949 log.cc:1196] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/caf5a92e0ddb4f05b02e90c053f906f2
I20260811 12:45:01.409250 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.386179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37024 (local address 127.0.186.65:44185)
0811 12:45:01.386376 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:01.386382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:01.395248 (+ 8866us) server_negotiation.cc:407] Connection header received
0811 12:45:01.395493 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:01.395499 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:01.395623 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:01.395757 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:01.396660 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.397982 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.400192 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.400908 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.401035 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.407180 (+ 6145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:01.407191 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:01.407208 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:01.408108 (+ 900us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:01.408181 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:01.408211 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:01.408343 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:01.408548 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 12:45:01.408671 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 12:45:01.409734 21949 ts_tablet_manager.cc:1939] T caf5a92e0ddb4f05b02e90c053f906f2 P 3488f9dc5740403392cec0f2ead30f4d: Deleting consensus metadata
I20260811 12:45:01.409999 21593 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:01.512231 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21455
I20260811 12:45:01.512408 21374 catalog_manager.cc:4841] TS 3488f9dc5740403392cec0f2ead30f4d (127.0.186.65:44185): tablet caf5a92e0ddb4f05b02e90c053f906f2 (table test-table [id=56ed98d96ad741e8b98d6c7afc6ea4fe]) successfully deleted
I20260811 12:45:01.540060 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21603
I20260811 12:45:01.547886 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.540994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59008 (local address 127.0.186.66:44681)
0811 12:45:01.541180 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:01.541184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:01.541203 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:45:01.541306 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:01.541310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:01.541405 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:01.541509 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:01.541917 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.542795 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.544175 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.544649 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.545056 (+ 407us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.546228 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:01.546269 (+ 41us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:01.546293 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:01.546953 (+ 660us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:01.547093 (+ 140us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:01.547129 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:01.547242 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:01.547384 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 12:45:01.547486 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:45:01.548605 21741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:01.642546 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21603
I20260811 12:45:01.666844 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21750
I20260811 12:45:01.675227 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:01.667665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.0.186.67:46643)
0811 12:45:01.667841 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:01.667846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:01.667907 (+ 61us) server_negotiation.cc:407] Connection header received
0811 12:45:01.668116 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:01.668119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:01.668237 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:01.668321 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:01.668840 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.670077 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.671931 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:01.672387 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:01.672508 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:01.673768 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:01.673776 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:01.673790 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:01.674376 (+ 586us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:01.674428 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:01.674447 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:01.674552 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:01.674701 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 12:45:01.674803 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:45:01.676002 21887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:01.769421 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21750
I20260811 12:45:01.790393 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21358
I20260811 12:45:01.791695 21425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:01.907074 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21358
2026-08-11T12:45:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3504 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:02 dist-test-slave-qg60 krb5kdc[21958](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:02 dist-test-slave-qg60 krb5kdc[21958](info): set up 2 sockets
Aug 11 12:45:02 dist-test-slave-qg60 krb5kdc[21958](info): commencing operation
krb5kdc: starting...
W20260811 12:45:03.188283 745 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:03 dist-test-slave-qg60 krb5kdc[21958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:03.572000 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39559
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:03.944648 21972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:03.945060 21972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:03.945246 21972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:03.953197 21972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:03.953338 21972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:03.953436 21972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:03.953523 21972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:03.953593 21972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:03.964396 21972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:03.965965 21972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:03.967432 21972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:03.980501 21977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:03.980465 21981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:03.980557 21979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:03.982255 21972 server_base.cc:1034] running on GCE node
I20260811 12:45:03.983155 21972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:03.984715 21972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:03.986029 21972 hybrid_clock.cc:648] HybridClock initialized: now 1786452303985968 us; error 44 us; skew 500 ppm
I20260811 12:45:03.986416 21972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:03 dist-test-slave-qg60 krb5kdc[21958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452303, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:03.993794 21972 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:03.995564 21972 webserver.cc:460] Webserver started at http://127.0.186.126:35693/ using document root <none> and password file <none>
I20260811 12:45:03.996310 21972 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:03.996469 21972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:03.996894 21972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:04.000139 21972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "a11a63563d93489b8362b04a940f2e81"
format_stamp: "Formatted at 2026-08-11 12:45:03 on dist-test-slave-qg60"
server_key: "0bbbeb99c02ad723f064731620d3d684"
server_key_iv: "556df74865672a33562b79f4a66f89f9"
server_key_version: "encryptionkey@0"
I20260811 12:45:04.001109 21972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "a11a63563d93489b8362b04a940f2e81"
format_stamp: "Formatted at 2026-08-11 12:45:03 on dist-test-slave-qg60"
server_key: "0bbbeb99c02ad723f064731620d3d684"
server_key_iv: "556df74865672a33562b79f4a66f89f9"
server_key_version: "encryptionkey@0"
I20260811 12:45:04.007603 21972 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260811 12:45:04.011854 21989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:04.013832 21972 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:45:04.014048 21972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "a11a63563d93489b8362b04a940f2e81"
format_stamp: "Formatted at 2026-08-11 12:45:03 on dist-test-slave-qg60"
server_key: "0bbbeb99c02ad723f064731620d3d684"
server_key_iv: "556df74865672a33562b79f4a66f89f9"
server_key_version: "encryptionkey@0"
I20260811 12:45:04.014271 21972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:04.042161 21972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:04.047230 21972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:04.047516 21972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:04.069018 21972 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39559
I20260811 12:45:04.069114 22052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39559 every 8 connection(s)
I20260811 12:45:04.070503 21972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:04.074594 22053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:04.080808 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 21972
I20260811 12:45:04.081038 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:04.081670 745 external_mini_cluster.cc:1428] Setting key 2191c1b3ea00fd09da4e593c0af9fcae
I20260811 12:45:04.086633 22053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81: Bootstrap starting.
I20260811 12:45:04.090696 22053 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:04.092005 22053 log.cc:824] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:04.095890 22053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81: No bootstrap required, opened a new log
Aug 11 12:45:04 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:04.105508 22053 raft_consensus.cc:348] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a11a63563d93489b8362b04a940f2e81" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39559 } }
I20260811 12:45:04.105981 22053 raft_consensus.cc:374] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:04.106129 22053 raft_consensus.cc:729] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11a63563d93489b8362b04a940f2e81, State: Initialized, Role: FOLLOWER
I20260811 12:45:04.106961 22053 consensus_queue.cc:260] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a11a63563d93489b8362b04a940f2e81" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39559 } }
I20260811 12:45:04.107296 22053 raft_consensus.cc:388] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:04.107471 22053 raft_consensus.cc:482] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:04.107693 22053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:04.108712 22057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:04.083867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57562 (local address 127.0.186.126:39559)
0811 12:45:04.084861 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:04.084874 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:04.084916 (+ 42us) server_negotiation.cc:407] Connection header received
0811 12:45:04.086689 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:04.086744 (+ 55us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:04.087182 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:04.087537 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:04.089767 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:04.091209 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:04.093231 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:04.094085 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:04.094277 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:04.099977 (+ 5700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:04.099985 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:04.100004 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:04.100049 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:04.103559 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:04.104388 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:04.104396 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:04.104403 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:04.104602 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:04.105075 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:04.105079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:04.105081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:04.105662 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:04.106014 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:04.106563 (+ 549us) server_negotiation.cc:299] Negotiation successful
0811 12:45:04.107088 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":442,"threads_started":1}
I20260811 12:45:04.110857 22053 raft_consensus.cc:504] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a11a63563d93489b8362b04a940f2e81" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39559 } }
I20260811 12:45:04.111433 22053 leader_election.cc:302] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a11a63563d93489b8362b04a940f2e81; no voters:
I20260811 12:45:04.112241 22053 leader_election.cc:288] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:04.112373 22059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:04.113258 22059 raft_consensus.cc:686] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [term 1 LEADER]: Becoming Leader. State: Replica: a11a63563d93489b8362b04a940f2e81, State: Running, Role: LEADER
I20260811 12:45:04.113974 22059 consensus_queue.cc:237] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a11a63563d93489b8362b04a940f2e81" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39559 } }
I20260811 12:45:04.114986 22053 sys_catalog.cc:564] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:04.117741 22061 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a11a63563d93489b8362b04a940f2e81. Latest consensus state: current_term: 1 leader_uuid: "a11a63563d93489b8362b04a940f2e81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a11a63563d93489b8362b04a940f2e81" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39559 } } }
I20260811 12:45:04.117710 22060 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a11a63563d93489b8362b04a940f2e81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a11a63563d93489b8362b04a940f2e81" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39559 } } }
I20260811 12:45:04.118296 22060 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:04.118268 22061 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:04.121009 22066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:04.126991 22066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:04.137461 22066 catalog_manager.cc:1347] Generated new cluster ID: 2d1b660b2e264215aac6671f50266f00
I20260811 12:45:04.137610 22066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:04.156260 22066 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:04.157964 22066 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:04.166792 22066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81: Generated new TSK 0
I20260811 12:45:04.168004 22066 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:45:04.253108 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39559
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:04.642915 22083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:04.643239 22083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:04.643435 22083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:04.650956 22083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:04.651093 22083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:04.651301 22083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:45:04.661767 22083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39559
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:04.663182 22083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:04.664544 22083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:04.678252 22089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:04.678294 22091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:04.678339 22093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:04.682220 22083 server_base.cc:1034] running on GCE node
I20260811 12:45:04.682921 22083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:04.683907 22083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:04.685145 22083 hybrid_clock.cc:648] HybridClock initialized: now 1786452304685102 us; error 62 us; skew 500 ppm
I20260811 12:45:04.685483 22083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:04 dist-test-slave-qg60 krb5kdc[21958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:04.688903 22083 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:45:04.690557 22083 webserver.cc:460] Webserver started at http://127.0.186.65:43423/ using document root <none> and password file <none>
I20260811 12:45:04.691320 22083 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:04.691475 22083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:04.691810 22083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:04.694931 22083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "5bfe4c33da914151b801fa7aac97e2b7"
format_stamp: "Formatted at 2026-08-11 12:45:04 on dist-test-slave-qg60"
server_key: "40177f0bc7f01152ca17053d81305137"
server_key_iv: "91d8e527b66b56b1cf2f9ec1123dcf77"
server_key_version: "encryptionkey@0"
I20260811 12:45:04.695772 22083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "5bfe4c33da914151b801fa7aac97e2b7"
format_stamp: "Formatted at 2026-08-11 12:45:04 on dist-test-slave-qg60"
server_key: "40177f0bc7f01152ca17053d81305137"
server_key_iv: "91d8e527b66b56b1cf2f9ec1123dcf77"
server_key_version: "encryptionkey@0"
I20260811 12:45:04.701107 22083 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:45:04.704906 22101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:04.706305 22083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:04.706496 22083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "5bfe4c33da914151b801fa7aac97e2b7"
format_stamp: "Formatted at 2026-08-11 12:45:04 on dist-test-slave-qg60"
server_key: "40177f0bc7f01152ca17053d81305137"
server_key_iv: "91d8e527b66b56b1cf2f9ec1123dcf77"
server_key_version: "encryptionkey@0"
I20260811 12:45:04.706715 22083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:04.733053 22083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:04.737803 22083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:04.738138 22083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:04.739202 22083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:04.740633 22083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:04.740744 22083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:04.740901 22083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:04.740952 22083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:04.778494 22083 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:46079
I20260811 12:45:04.778544 22230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:46079 every 8 connection(s)
I20260811 12:45:04.779862 22083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:45:04.787416 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22083
I20260811 12:45:04.787648 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:45:04.788231 745 external_mini_cluster.cc:1428] Setting key 6a3d5521edda3b78e03d2f17ab1a7b1d
Aug 11 12:45:04 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:04.803601 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:04.782618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:54627 (local address 127.0.186.126:39559)
0811 12:45:04.783735 (+ 1117us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:04.783743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:04.784264 (+ 521us) server_negotiation.cc:407] Connection header received
0811 12:45:04.786290 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:04.786295 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:04.786392 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:04.786516 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:04.788605 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:04.789612 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:04.791954 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:04.792369 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:04.792479 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:04.797211 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:04.797217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:04.797220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:04.797254 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:04.799923 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:04.800933 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:04.800937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:04.800939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:04.801072 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:04.801610 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:04.801614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:04.801618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:04.801993 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:04.802167 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:04.803158 (+ 991us) server_negotiation.cc:299] Negotiation successful
0811 12:45:04.803339 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":950,"thread_start_us":802,"threads_started":1}
I20260811 12:45:04.805330 22234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:04.783317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39559 (local address 127.0.186.65:54627)
0811 12:45:04.784089 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:04.784135 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:04.786003 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:04.786762 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:04.786770 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:04.787522 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:04.788361 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:04.788388 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:04.789795 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:04.789799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:04.791769 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:04.791787 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:04.792619 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:04.792629 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:04.793001 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:04.793813 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:45:04.793849 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:04.796950 (+ 3101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:04.800073 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:04.800086 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:04.800108 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:04.800795 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:04.801189 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:04.801196 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:04.801202 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:04.801462 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:04.802195 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:04.802206 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:04.802676 (+ 470us) client_negotiation.cc:769] Sending connection context
0811 12:45:04.803012 (+ 336us) client_negotiation.cc:240] Negotiation successful
0811 12:45:04.803632 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":316,"threads_started":1}
I20260811 12:45:04.807164 22231 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39559
I20260811 12:45:04.807503 22231 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:04.808256 22231 heartbeater.cc:511] Master 127.0.186.126:39559 requested a full tablet report, sending...
I20260811 12:45:04.810678 22007 ts_manager.cc:194] Registered new tserver with Master: 5bfe4c33da914151b801fa7aac97e2b7 (127.0.186.65:46079)
I20260811 12:45:04.812775 22007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:54627
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:45:04.870321 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39559
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:05.234493 22237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:05.234973 22237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:05.235147 22237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:05.245515 22237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:05.245639 22237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:05.245869 22237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:45:05.262301 22237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39559
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:05.264137 22237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:05.266057 22237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:05.281805 22243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:05.281844 22246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:05.281991 22244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:05.282922 22237 server_base.cc:1034] running on GCE node
I20260811 12:45:05.283695 22237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:05.285367 22237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:05.286619 22237 hybrid_clock.cc:648] HybridClock initialized: now 1786452305286565 us; error 66 us; skew 500 ppm
I20260811 12:45:05.286969 22237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:05 dist-test-slave-qg60 krb5kdc[21958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452305, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:05.290370 22237 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:45:05.291975 22237 webserver.cc:460] Webserver started at http://127.0.186.66:36793/ using document root <none> and password file <none>
I20260811 12:45:05.292780 22237 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:05.292951 22237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:05.293286 22237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:05.296856 22237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "9e4dbffa6491422d864feb52c05329f2"
format_stamp: "Formatted at 2026-08-11 12:45:05 on dist-test-slave-qg60"
server_key: "e1721d81b820e5f74b345944e8e6fe71"
server_key_iv: "766f330a08a5896ac952d2524bc2cf57"
server_key_version: "encryptionkey@0"
I20260811 12:45:05.297701 22237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "9e4dbffa6491422d864feb52c05329f2"
format_stamp: "Formatted at 2026-08-11 12:45:05 on dist-test-slave-qg60"
server_key: "e1721d81b820e5f74b345944e8e6fe71"
server_key_iv: "766f330a08a5896ac952d2524bc2cf57"
server_key_version: "encryptionkey@0"
I20260811 12:45:05.303251 22237 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:05.307300 22253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:05.308815 22237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 12:45:05.309008 22237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "9e4dbffa6491422d864feb52c05329f2"
format_stamp: "Formatted at 2026-08-11 12:45:05 on dist-test-slave-qg60"
server_key: "e1721d81b820e5f74b345944e8e6fe71"
server_key_iv: "766f330a08a5896ac952d2524bc2cf57"
server_key_version: "encryptionkey@0"
I20260811 12:45:05.309234 22237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:05.343463 22237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:05.348263 22237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:05.348595 22237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:05.349741 22237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:05.351279 22237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:05.351356 22237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:05.351503 22237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:05.351557 22237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:05.387512 22237 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:44369
I20260811 12:45:05.387634 22379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:44369 every 8 connection(s)
I20260811 12:45:05.388934 22237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:45:05.397433 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22237
I20260811 12:45:05.397646 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:45:05.398264 745 external_mini_cluster.cc:1428] Setting key cb5837ab920acfdd611e736ec2ccd45b
Aug 11 12:45:05 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452305, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:05.412225 22384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:05.391730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:60017 (local address 127.0.186.126:39559)
0811 12:45:05.392250 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:05.392255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:05.393389 (+ 1134us) server_negotiation.cc:407] Connection header received
0811 12:45:05.395254 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:05.395259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:05.395333 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:05.395439 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:05.397175 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.398323 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.400192 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.400877 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.400994 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:05.405623 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:05.405629 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:05.405632 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:05.405668 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:05.408470 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:05.409329 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:05.409336 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:05.409344 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:05.409467 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:05.409979 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:05.409988 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:05.409995 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:05.410426 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:05.410591 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:05.411454 (+ 863us) server_negotiation.cc:299] Negotiation successful
0811 12:45:05.411723 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":272,"threads_started":1}
I20260811 12:45:05.413137 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:05.392359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39559 (local address 127.0.186.66:60017)
0811 12:45:05.393204 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:05.393257 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:05.394967 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:05.395656 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:05.395664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:05.396245 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:05.396912 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:05.396933 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.398549 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.398553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:05.400034 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:05.400048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.401176 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.401184 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:05.401515 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:05.402354 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:45:05.402399 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:05.405352 (+ 2953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:05.408633 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:05.408642 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:05.408660 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:05.409189 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:05.409586 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:05.409592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:05.409595 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:05.409801 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:05.410569 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:05.410575 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:05.410996 (+ 421us) client_negotiation.cc:769] Sending connection context
0811 12:45:05.411311 (+ 315us) client_negotiation.cc:240] Negotiation successful
0811 12:45:05.411733 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":381,"threads_started":1}
I20260811 12:45:05.414777 22380 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39559
I20260811 12:45:05.415119 22380 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:05.415956 22380 heartbeater.cc:511] Master 127.0.186.126:39559 requested a full tablet report, sending...
I20260811 12:45:05.417649 22007 ts_manager.cc:194] Registered new tserver with Master: 9e4dbffa6491422d864feb52c05329f2 (127.0.186.66:44369)
I20260811 12:45:05.418633 22007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:60017
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:45:05.477754 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39559
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:45:05.816890 22231 heartbeater.cc:503] Master 127.0.186.126:39559 was elected leader, sending a full tablet report...
W20260811 12:45:05.846693 22388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:05.847010 22388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:05.847110 22388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:05.854663 22388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:05.854785 22388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:05.854943 22388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:45:05.865245 22388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39559
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:05.866580 22388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:05.867888 22388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:05.881875 22394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:05.881794 22395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:05.881923 22398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:05.883437 22388 server_base.cc:1034] running on GCE node
I20260811 12:45:05.884231 22388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:05.885452 22388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:05.886725 22388 hybrid_clock.cc:648] HybridClock initialized: now 1786452305886676 us; error 53 us; skew 500 ppm
I20260811 12:45:05.887156 22388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:05 dist-test-slave-qg60 krb5kdc[21958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452305, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:05.890959 22388 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:45:05.892709 22388 webserver.cc:460] Webserver started at http://127.0.186.67:37961/ using document root <none> and password file <none>
I20260811 12:45:05.893682 22388 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:05.893843 22388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:05.894200 22388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:05.897564 22388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "682829adfa8a43f087e5a738fd3c9fc1"
format_stamp: "Formatted at 2026-08-11 12:45:05 on dist-test-slave-qg60"
server_key: "e16caf9e340dfbf3cac716912c479cbd"
server_key_iv: "02f301af0bed5e3bf8eddec9dfe6c002"
server_key_version: "encryptionkey@0"
I20260811 12:45:05.898468 22388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "682829adfa8a43f087e5a738fd3c9fc1"
format_stamp: "Formatted at 2026-08-11 12:45:05 on dist-test-slave-qg60"
server_key: "e16caf9e340dfbf3cac716912c479cbd"
server_key_iv: "02f301af0bed5e3bf8eddec9dfe6c002"
server_key_version: "encryptionkey@0"
I20260811 12:45:05.904284 22388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 12:45:05.908169 22406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:05.909679 22388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:05.909883 22388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "682829adfa8a43f087e5a738fd3c9fc1"
format_stamp: "Formatted at 2026-08-11 12:45:05 on dist-test-slave-qg60"
server_key: "e16caf9e340dfbf3cac716912c479cbd"
server_key_iv: "02f301af0bed5e3bf8eddec9dfe6c002"
server_key_version: "encryptionkey@0"
I20260811 12:45:05.910213 22388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:05.937188 22388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:05.942190 22388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:05.942544 22388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:05.943717 22388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:05.945487 22388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:05.945603 22388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:05.945765 22388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:05.945845 22388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:05.984443 22388 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:44561
I20260811 12:45:05.984489 22529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:44561 every 8 connection(s)
I20260811 12:45:05.985927 22388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:45:05.995599 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22388
I20260811 12:45:05.995790 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:45:05.996255 745 external_mini_cluster.cc:1428] Setting key cb4685b41e27d1d9e0ed3cbb066db697
Aug 11 12:45:05 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452305, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:06.009045 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:05.988711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:53455 (local address 127.0.186.126:39559)
0811 12:45:05.989295 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:05.989301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:05.990221 (+ 920us) server_negotiation.cc:407] Connection header received
0811 12:45:05.992366 (+ 2145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:05.992373 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:05.992492 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:05.992631 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:05.994379 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.995280 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.997392 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.997979 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.998152 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.002329 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:06.002335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:06.002339 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:06.002380 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:06.005379 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.006231 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.006235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.006238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.006461 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.006919 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.006922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.006925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.007276 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:06.007420 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.008375 (+ 955us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.008624 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":271,"threads_started":1}
I20260811 12:45:06.010123 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:05.989266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39559 (local address 127.0.186.67:53455)
0811 12:45:05.990036 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:05.990082 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:05.992054 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:05.992934 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:05.992944 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:05.993537 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:05.994175 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:05.994194 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.995454 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.995462 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:05.997228 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:05.997242 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:05.998245 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:05.998250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:05.998577 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:05.999477 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:45:05.999513 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:06.002056 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:06.005554 (+ 3498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:06.005563 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:06.005579 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:06.006077 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:06.006581 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:06.006585 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:06.006587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:06.006797 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:06.007441 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:06.007449 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:06.007847 (+ 398us) client_negotiation.cc:769] Sending connection context
0811 12:45:06.008225 (+ 378us) client_negotiation.cc:240] Negotiation successful
0811 12:45:06.008705 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":311,"threads_started":1}
I20260811 12:45:06.012182 22530 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39559
I20260811 12:45:06.012619 22530 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:06.013535 22530 heartbeater.cc:511] Master 127.0.186.126:39559 requested a full tablet report, sending...
I20260811 12:45:06.015264 22007 ts_manager.cc:194] Registered new tserver with Master: 682829adfa8a43f087e5a738fd3c9fc1 (127.0.186.67:44561)
I20260811 12:45:06.016275 22007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:53455
I20260811 12:45:06.025509 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:45:06.044708 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.030050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.0.186.126:39559)
0811 12:45:06.030289 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.030298 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.030835 (+ 537us) server_negotiation.cc:407] Connection header received
0811 12:45:06.030969 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.030973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.031070 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.031166 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:06.032786 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.033682 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.035072 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.035532 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.035651 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.038571 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:06.038577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:06.038581 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:06.038620 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:06.041636 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.042457 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.042462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.042464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.042606 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.043086 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.043090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.043093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.043499 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:06.043742 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.044100 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.044256 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 12:45:06.049326 22007 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:45:06.057322 22007 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:45:06.104997 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.072379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:44561 (local address 127.0.0.1:60854)
0811 12:45:06.089587 (+ 17208us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:06.089666 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:06.089947 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:06.094382 (+ 4435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:06.094410 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:06.094465 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:06.095112 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.095134 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.097809 (+ 2675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.097816 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.100863 (+ 3047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.100879 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.103613 (+ 2734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.103624 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.103951 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.104033 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 12:45:06.104219 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 12:45:06.104517 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16762,"thread_start_us":16548,"threads_started":1}
I20260811 12:45:06.105510 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.072629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60854 (local address 127.0.186.67:44561)
0811 12:45:06.093024 (+ 20395us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.093039 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.093090 (+ 51us) server_negotiation.cc:407] Connection header received
0811 12:45:06.093235 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.093248 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.093630 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.093916 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:06.095430 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.097619 (+ 2189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.101108 (+ 3489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.102966 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.103120 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.103454 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.104872 (+ 1418us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.105121 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20155,"thread_start_us":19914,"threads_started":1}
I20260811 12:45:06.110370 22460 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebb1a99a74b4379b8f5cb6a47357ede (DEFAULT_TABLE table=test-table [id=70539ceeb4644e5a96585d19b01bb4d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:06.112213 22460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebb1a99a74b4379b8f5cb6a47357ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:06.113219 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.073145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46079 (local address 127.0.0.1:50434)
0811 12:45:06.097446 (+ 24301us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:06.097476 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:06.097618 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:06.099972 (+ 2354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:06.099979 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:06.100011 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:06.100558 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.100572 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.105007 (+ 4435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.105013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.108475 (+ 3462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.108494 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.111155 (+ 2661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.111164 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.111583 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.112422 (+ 839us) client_negotiation.cc:769] Sending connection context
0811 12:45:06.112541 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 12:45:06.112723 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24139,"mutex_wait_us":791,"thread_start_us":31286,"threads_started":1}
I20260811 12:45:06.113252 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.073893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50434 (local address 127.0.186.65:46079)
0811 12:45:06.098252 (+ 24359us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.098263 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.098296 (+ 33us) server_negotiation.cc:407] Connection header received
0811 12:45:06.098396 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.098405 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.098738 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.098961 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:06.102600 (+ 3639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.104770 (+ 2170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.108718 (+ 3948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.110341 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.110565 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.110865 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.112626 (+ 1761us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.112864 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24145,"thread_start_us":25796,"threads_started":1}
I20260811 12:45:06.114715 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.073266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:44369 (local address 127.0.0.1:46378)
0811 12:45:06.103072 (+ 29806us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:06.103102 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:06.103242 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:06.107064 (+ 3822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:06.107068 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:06.107094 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:06.107399 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.107411 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.109169 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.109175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.111519 (+ 2344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.111536 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.113806 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.113814 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.114026 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.114065 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 12:45:06.114171 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 12:45:06.114323 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29636,"thread_start_us":23776,"threads_started":1}
I20260811 12:45:06.115777 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.074079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46378 (local address 127.0.186.66:44369)
0811 12:45:06.099645 (+ 25566us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.099658 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.104719 (+ 5061us) server_negotiation.cc:407] Connection header received
0811 12:45:06.105563 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.105576 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.106737 (+ 1161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.107018 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:06.107598 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.108991 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.111728 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.113390 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.113670 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.114973 (+ 1303us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.115144 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.115375 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25368,"thread_start_us":25234,"threads_started":1}
I20260811 12:45:06.118287 22158 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebb1a99a74b4379b8f5cb6a47357ede (DEFAULT_TABLE table=test-table [id=70539ceeb4644e5a96585d19b01bb4d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:06.119282 22309 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebb1a99a74b4379b8f5cb6a47357ede (DEFAULT_TABLE table=test-table [id=70539ceeb4644e5a96585d19b01bb4d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:06.120054 22158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebb1a99a74b4379b8f5cb6a47357ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:06.120541 22309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebb1a99a74b4379b8f5cb6a47357ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:06.132359 22554 tablet_bootstrap.cc:492] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Bootstrap starting.
I20260811 12:45:06.134634 22555 tablet_bootstrap.cc:492] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Bootstrap starting.
I20260811 12:45:06.136582 22554 tablet_bootstrap.cc:654] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:06.136933 22556 tablet_bootstrap.cc:492] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Bootstrap starting.
I20260811 12:45:06.138132 22554 log.cc:824] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:06.138540 22555 tablet_bootstrap.cc:654] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:06.139959 22555 log.cc:824] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:06.140789 22556 tablet_bootstrap.cc:654] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:06.141938 22556 log.cc:824] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:06.143424 22554 tablet_bootstrap.cc:492] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: No bootstrap required, opened a new log
I20260811 12:45:06.143424 22555 tablet_bootstrap.cc:492] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: No bootstrap required, opened a new log
I20260811 12:45:06.143746 22554 ts_tablet_manager.cc:1397] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260811 12:45:06.143738 22555 ts_tablet_manager.cc:1397] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 12:45:06.144486 22556 tablet_bootstrap.cc:492] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: No bootstrap required, opened a new log
I20260811 12:45:06.144814 22556 ts_tablet_manager.cc:1397] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260811 12:45:06.152673 22556 raft_consensus.cc:348] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.153149 22556 raft_consensus.cc:374] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:06.153249 22556 raft_consensus.cc:729] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bfe4c33da914151b801fa7aac97e2b7, State: Initialized, Role: FOLLOWER
I20260811 12:45:06.153903 22556 consensus_queue.cc:260] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.156191 22555 raft_consensus.cc:348] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.156790 22555 raft_consensus.cc:374] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:06.156917 22555 raft_consensus.cc:729] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e4dbffa6491422d864feb52c05329f2, State: Initialized, Role: FOLLOWER
I20260811 12:45:06.156574 22554 raft_consensus.cc:348] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.157117 22554 raft_consensus.cc:374] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:06.157232 22554 raft_consensus.cc:729] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682829adfa8a43f087e5a738fd3c9fc1, State: Initialized, Role: FOLLOWER
I20260811 12:45:06.157377 22556 ts_tablet_manager.cc:1428] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260811 12:45:06.157836 22555 consensus_queue.cc:260] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.157863 22554 consensus_queue.cc:260] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.159649 22530 heartbeater.cc:503] Master 127.0.186.126:39559 was elected leader, sending a full tablet report...
I20260811 12:45:06.160106 22555 ts_tablet_manager.cc:1428] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260811 12:45:06.160341 22554 ts_tablet_manager.cc:1428] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260811 12:45:06.160848 22380 heartbeater.cc:503] Master 127.0.186.126:39559 was elected leader, sending a full tablet report...
W20260811 12:45:06.237854 22531 tablet.cc:2369] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:06.282727 22232 tablet.cc:2369] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:06.391185 22383 tablet.cc:2369] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:45:06.404547 22561 raft_consensus.cc:482] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:45:06.405049 22561 raft_consensus.cc:504] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.406987 22561 leader_election.cc:288] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 682829adfa8a43f087e5a738fd3c9fc1 (127.0.186.67:44561), 5bfe4c33da914151b801fa7aac97e2b7 (127.0.186.65:46079)
I20260811 12:45:06.417292 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.407770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:37701 (local address 127.0.186.65:46079)
0811 12:45:06.408044 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.408053 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.408636 (+ 583us) server_negotiation.cc:407] Connection header received
0811 12:45:06.408920 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.408925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.408999 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.409088 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:06.410260 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.411384 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.414644 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.415959 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.416174 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.416256 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.416873 (+ 617us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.417020 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:45:06.417300 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.407781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:41475 (local address 127.0.186.67:44561)
0811 12:45:06.408034 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.408044 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.408702 (+ 658us) server_negotiation.cc:407] Connection header received
0811 12:45:06.408868 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.408874 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.408971 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.409080 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:06.410220 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.411364 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.414626 (+ 3262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.416025 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.416216 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.416288 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.416873 (+ 585us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.417020 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 12:45:06.417610 22564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.407412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:44561 (local address 127.0.186.66:41475)
0811 12:45:06.408591 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:06.408608 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:06.408718 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:06.409142 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:06.409148 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:06.409254 (+ 106us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:06.409819 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.409844 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.411562 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.411568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.414407 (+ 2839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.414425 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.416296 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.416309 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.416586 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.416689 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 12:45:06.416814 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 12:45:06.417044 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1029,"mutex_wait_us":365,"spinlock_wait_cycles":24960,"thread_start_us":850,"threads_started":1}
I20260811 12:45:06.417968 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.407338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:46079 (local address 127.0.186.66:37701)
0811 12:45:06.408475 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:06.408506 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:06.408698 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:06.409143 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:06.409148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:06.409182 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:06.410110 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.410126 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.411564 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.411568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.414452 (+ 2884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:06.414464 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.416331 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.416338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:06.416590 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.416685 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 12:45:06.416814 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 12:45:06.417043 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":930,"mutex_wait_us":260,"thread_start_us":712,"threads_started":1}
I20260811 12:45:06.418793 22483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebb1a99a74b4379b8f5cb6a47357ede" candidate_uuid: "9e4dbffa6491422d864feb52c05329f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682829adfa8a43f087e5a738fd3c9fc1" is_pre_election: true
I20260811 12:45:06.419430 22483 raft_consensus.cc:2454] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e4dbffa6491422d864feb52c05329f2 in term 0.
I20260811 12:45:06.419273 22180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebb1a99a74b4379b8f5cb6a47357ede" candidate_uuid: "9e4dbffa6491422d864feb52c05329f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bfe4c33da914151b801fa7aac97e2b7" is_pre_election: true
I20260811 12:45:06.419876 22180 raft_consensus.cc:2454] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e4dbffa6491422d864feb52c05329f2 in term 0.
I20260811 12:45:06.420240 22257 leader_election.cc:302] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682829adfa8a43f087e5a738fd3c9fc1, 9e4dbffa6491422d864feb52c05329f2; no voters:
I20260811 12:45:06.420819 22561 raft_consensus.cc:2781] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:45:06.420984 22561 raft_consensus.cc:482] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:45:06.421108 22561 raft_consensus.cc:3037] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:06.423589 22561 raft_consensus.cc:504] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.424280 22561 leader_election.cc:288] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [CANDIDATE]: Term 1 election: Requested vote from peers 682829adfa8a43f087e5a738fd3c9fc1 (127.0.186.67:44561), 5bfe4c33da914151b801fa7aac97e2b7 (127.0.186.65:46079)
I20260811 12:45:06.424908 22180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebb1a99a74b4379b8f5cb6a47357ede" candidate_uuid: "9e4dbffa6491422d864feb52c05329f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bfe4c33da914151b801fa7aac97e2b7"
I20260811 12:45:06.424908 22483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebb1a99a74b4379b8f5cb6a47357ede" candidate_uuid: "9e4dbffa6491422d864feb52c05329f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682829adfa8a43f087e5a738fd3c9fc1"
I20260811 12:45:06.425158 22180 raft_consensus.cc:3037] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:06.425158 22483 raft_consensus.cc:3037] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:06.428704 22483 raft_consensus.cc:2454] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e4dbffa6491422d864feb52c05329f2 in term 1.
I20260811 12:45:06.428704 22180 raft_consensus.cc:2454] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e4dbffa6491422d864feb52c05329f2 in term 1.
I20260811 12:45:06.429399 22257 leader_election.cc:302] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5bfe4c33da914151b801fa7aac97e2b7, 682829adfa8a43f087e5a738fd3c9fc1, 9e4dbffa6491422d864feb52c05329f2; no voters:
I20260811 12:45:06.429960 22561 raft_consensus.cc:2781] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:06.430596 22561 raft_consensus.cc:686] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e4dbffa6491422d864feb52c05329f2, State: Running, Role: LEADER
I20260811 12:45:06.431239 22561 consensus_queue.cc:237] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } }
I20260811 12:45:06.436867 22006 catalog_manager.cc:5495] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e4dbffa6491422d864feb52c05329f2 (127.0.186.66). New cstate: current_term: 1 leader_uuid: "9e4dbffa6491422d864feb52c05329f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e4dbffa6491422d864feb52c05329f2" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 } health_report { overall_health: UNKNOWN } } }
I20260811 12:45:06.482334 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.476433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46392 (local address 127.0.186.66:44369)
0811 12:45:06.476701 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.476707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.476762 (+ 55us) server_negotiation.cc:407] Connection header received
0811 12:45:06.477001 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.477005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.477089 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.477231 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:45:06.477709 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.478476 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.479897 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.480312 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.480411 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.481149 (+ 738us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:45:06.481681 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:45:06.481828 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.482047 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.482094 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 12:45:06.491662 22180 raft_consensus.cc:1261] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 1 FOLLOWER]: Refusing update from remote peer 9e4dbffa6491422d864feb52c05329f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:06.491662 22483 raft_consensus.cc:1261] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 1 FOLLOWER]: Refusing update from remote peer 9e4dbffa6491422d864feb52c05329f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:06.492959 22561 consensus_queue.cc:1035] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682829adfa8a43f087e5a738fd3c9fc1" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 44561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:06.493389 22565 consensus_queue.cc:1035] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bfe4c33da914151b801fa7aac97e2b7" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:06.507558 22569 mvcc.cc:205] Tried to move back new op lower bound from 7317308647377563648 to 7317308647146840064. Current Snapshot: MvccSnapshot[applied={T|T < 7317308647377563648}]
I20260811 12:45:06.509277 22568 mvcc.cc:205] Tried to move back new op lower bound from 7317308647377563648 to 7317308647146840064. Current Snapshot: MvccSnapshot[applied={T|T < 7317308647377563648}]
I20260811 12:45:06.524161 22006 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:06.524484 22006 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:06.528704 22006 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a11a63563d93489b8362b04a940f2e81: Sending DeleteTablet for 3 replicas of tablet 4ebb1a99a74b4379b8f5cb6a47357ede
I20260811 12:45:06.530124 22460 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebb1a99a74b4379b8f5cb6a47357ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:06 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:60854
I20260811 12:45:06.530159 22309 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebb1a99a74b4379b8f5cb6a47357ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:06 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:46378
I20260811 12:45:06.530189 22158 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebb1a99a74b4379b8f5cb6a47357ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:06 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:50434
I20260811 12:45:06.536988 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22083
I20260811 12:45:06.544180 22583 tablet_replica.cc:330] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: stopping tablet replica
I20260811 12:45:06.544868 22583 raft_consensus.cc:2229] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:06.545639 22583 raft_consensus.cc:2258] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:06.546732 22582 tablet_replica.cc:330] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: stopping tablet replica
I20260811 12:45:06.547228 22582 raft_consensus.cc:2229] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:45:06.548007 22582 raft_consensus.cc:2258] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:06.548676 22583 ts_tablet_manager.cc:1905] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:06.550572 22582 ts_tablet_manager.cc:1905] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:06.556517 22583 ts_tablet_manager.cc:1918] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:06.556718 22583 log.cc:1196] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/4ebb1a99a74b4379b8f5cb6a47357ede
I20260811 12:45:06.557566 22583 ts_tablet_manager.cc:1939] T 4ebb1a99a74b4379b8f5cb6a47357ede P 5bfe4c33da914151b801fa7aac97e2b7: Deleting consensus metadata
I20260811 12:45:06.559700 21990 catalog_manager.cc:4841] TS 5bfe4c33da914151b801fa7aac97e2b7 (127.0.186.65:46079): tablet 4ebb1a99a74b4379b8f5cb6a47357ede (table test-table [id=70539ceeb4644e5a96585d19b01bb4d4]) successfully deleted
I20260811 12:45:06.559978 22582 ts_tablet_manager.cc:1918] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:06.560196 22582 log.cc:1196] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/4ebb1a99a74b4379b8f5cb6a47357ede
I20260811 12:45:06.560811 22582 ts_tablet_manager.cc:1939] T 4ebb1a99a74b4379b8f5cb6a47357ede P 9e4dbffa6491422d864feb52c05329f2: Deleting consensus metadata
I20260811 12:45:06.563184 22581 tablet_replica.cc:330] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: stopping tablet replica
I20260811 12:45:06.563162 21992 catalog_manager.cc:4841] TS 9e4dbffa6491422d864feb52c05329f2 (127.0.186.66:44369): tablet 4ebb1a99a74b4379b8f5cb6a47357ede (table test-table [id=70539ceeb4644e5a96585d19b01bb4d4]) successfully deleted
I20260811 12:45:06.563628 22581 raft_consensus.cc:2229] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:06.564153 22581 raft_consensus.cc:2258] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:06.566188 22581 ts_tablet_manager.cc:1905] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 12:45:06 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:45:06.572327 22581 ts_tablet_manager.cc:1918] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:06.572525 22581 log.cc:1196] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/4ebb1a99a74b4379b8f5cb6a47357ede
I20260811 12:45:06.573066 22581 ts_tablet_manager.cc:1939] T 4ebb1a99a74b4379b8f5cb6a47357ede P 682829adfa8a43f087e5a738fd3c9fc1: Deleting consensus metadata
I20260811 12:45:06.575066 21993 catalog_manager.cc:4841] TS 682829adfa8a43f087e5a738fd3c9fc1 (127.0.186.67:44561): tablet 4ebb1a99a74b4379b8f5cb6a47357ede (table test-table [id=70539ceeb4644e5a96585d19b01bb4d4]) successfully deleted
I20260811 12:45:06.577426 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.538209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50446 (local address 127.0.186.65:46079)
0811 12:45:06.538469 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.538479 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.555446 (+ 16967us) server_negotiation.cc:407] Connection header received
0811 12:45:06.556014 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.556021 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.556122 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.556202 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:06.558664 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.559889 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.562030 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.562700 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.562830 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.569195 (+ 6365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:06.569214 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:06.569233 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:06.569294 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:06.573693 (+ 4399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.574748 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.574758 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.574762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.575018 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.575518 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.575524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.575528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.576052 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:06.576394 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.576699 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.577012 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:45:06.578197 22224 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:06.716137 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22083
I20260811 12:45:06.740478 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22237
Aug 11 12:45:06 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:45:06.761842 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.741475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.0.186.66:44369)
0811 12:45:06.741688 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.741693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.741712 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:45:06.741925 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.741929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.741996 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.742085 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:06.743848 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.745330 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.747474 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.748190 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.748344 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.754096 (+ 5752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:06.754121 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:06.754142 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:06.754194 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:06.758348 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.759320 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.759331 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.759335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.759506 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.759938 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.759945 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.759960 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.760485 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:06.760878 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.761149 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.761416 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 12:45:06.762673 22375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:06.883482 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22237
I20260811 12:45:06.907982 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22388
Aug 11 12:45:06 dist-test-slave-qg60 krb5kdc[21958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:45:06.925921 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:06.908858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60856 (local address 127.0.186.67:44561)
0811 12:45:06.909102 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:06.909107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:06.909129 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:45:06.909323 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:06.909328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:06.909421 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:06.909519 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:06.910908 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.911680 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.913125 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:06.913548 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:06.913658 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:06.918836 (+ 5178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:06.918854 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:06.918871 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:06.918917 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:06.922436 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.923377 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.923386 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.923395 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.923566 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:06.924046 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:06.924050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:06.924053 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:06.924474 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:06.924858 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:06.925267 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 12:45:06.925536 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 12:45:06.926676 22525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:07.020285 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22388
I20260811 12:45:07.042842 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 21972
I20260811 12:45:07.044070 22046 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:07.162905 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 21972
2026-08-11T12:45:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5256 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T12:45:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:07Z Disabled control of system clock
I20260811 12:45:07.271471 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45451
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:34083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:45451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 12:45:07.640100 22593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:07.640421 22593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:07.640563 22593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:07.648100 22593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:07.648224 22593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:07.648321 22593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:07.648463 22593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:07.648545 22593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:07.658488 22593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:45451
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:07.659948 22593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:07.661974 22593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:07.675426 22602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:07.675509 22604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:07.675496 22601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:07.681810 22593 server_base.cc:1034] running on GCE node
I20260811 12:45:07.682711 22593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:07.684243 22593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:07.685467 22593 hybrid_clock.cc:648] HybridClock initialized: now 1786452307685399 us; error 59 us; skew 500 ppm
I20260811 12:45:07.685873 22593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:07.688355 22593 webserver.cc:460] Webserver started at http://127.0.186.126:33045/ using document root <none> and password file <none>
I20260811 12:45:07.689165 22593 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:07.689288 22593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:07.689639 22593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:07.692649 22593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "6011547b1fcd4a148ce09f443a35e436"
format_stamp: "Formatted at 2026-08-11 12:45:07 on dist-test-slave-qg60"
server_key: "19db5163c6d923394c771ed3677feaa6"
server_key_iv: "84fbb5c76cd9d1732c2b1f8f8fd736e9"
server_key_version: "encryptionkey@0"
I20260811 12:45:07.693596 22593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "6011547b1fcd4a148ce09f443a35e436"
format_stamp: "Formatted at 2026-08-11 12:45:07 on dist-test-slave-qg60"
server_key: "19db5163c6d923394c771ed3677feaa6"
server_key_iv: "84fbb5c76cd9d1732c2b1f8f8fd736e9"
server_key_version: "encryptionkey@0"
I20260811 12:45:07.699169 22593 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:07.702970 22611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:07.704461 22593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:45:07.704668 22593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "6011547b1fcd4a148ce09f443a35e436"
format_stamp: "Formatted at 2026-08-11 12:45:07 on dist-test-slave-qg60"
server_key: "19db5163c6d923394c771ed3677feaa6"
server_key_iv: "84fbb5c76cd9d1732c2b1f8f8fd736e9"
server_key_version: "encryptionkey@0"
I20260811 12:45:07.704985 22593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:07.727264 22593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:07.728255 22593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:07.728578 22593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:07.748644 22593 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:45451
I20260811 12:45:07.748665 22666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:45451 every 8 connection(s)
I20260811 12:45:07.750131 22593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:07.754118 22667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:07.759346 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22593
I20260811 12:45:07.759537 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:07.759994 745 external_mini_cluster.cc:1428] Setting key 33f17b49ecf30913665d34f94d55c08c
I20260811 12:45:07.765455 22667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436: Bootstrap starting.
I20260811 12:45:07.769271 22667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:07.770613 22667 log.cc:824] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:07.773900 22667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436: No bootstrap required, opened a new log
I20260811 12:45:07.774935 22670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:07.762124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40898 (local address 127.0.186.126:45451)
0811 12:45:07.763351 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:07.763371 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:07.763420 (+ 49us) server_negotiation.cc:407] Connection header received
0811 12:45:07.765260 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:07.765283 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:07.765802 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:07.766131 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:07.766786 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:07.768104 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:07.770126 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:07.770902 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:07.771039 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:07.772446 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:07.772454 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:07.772469 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:07.773096 (+ 627us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:07.773181 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:07.773203 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:07.773346 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:07.773576 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 12:45:07.773902 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":516,"threads_started":1}
I20260811 12:45:07.782387 22667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6011547b1fcd4a148ce09f443a35e436" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45451 } }
I20260811 12:45:07.782920 22667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:07.783028 22667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6011547b1fcd4a148ce09f443a35e436, State: Initialized, Role: FOLLOWER
I20260811 12:45:07.783759 22667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6011547b1fcd4a148ce09f443a35e436" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45451 } }
I20260811 12:45:07.784055 22667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:07.784209 22667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:07.784377 22667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:07.786823 22667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6011547b1fcd4a148ce09f443a35e436" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45451 } }
I20260811 12:45:07.787357 22667 leader_election.cc:302] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6011547b1fcd4a148ce09f443a35e436; no voters:
I20260811 12:45:07.788173 22667 leader_election.cc:288] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:07.788331 22673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:07.789296 22673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [term 1 LEADER]: Becoming Leader. State: Replica: 6011547b1fcd4a148ce09f443a35e436, State: Running, Role: LEADER
I20260811 12:45:07.789947 22673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6011547b1fcd4a148ce09f443a35e436" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45451 } }
I20260811 12:45:07.790585 22667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:07.792775 22674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6011547b1fcd4a148ce09f443a35e436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6011547b1fcd4a148ce09f443a35e436" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45451 } } }
I20260811 12:45:07.793632 22674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:07.794040 22675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6011547b1fcd4a148ce09f443a35e436. Latest consensus state: current_term: 1 leader_uuid: "6011547b1fcd4a148ce09f443a35e436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6011547b1fcd4a148ce09f443a35e436" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45451 } } }
I20260811 12:45:07.794692 22675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:07.797425 22682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:07.803402 22682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:07.812867 22682 catalog_manager.cc:1347] Generated new cluster ID: 5085e95a26f84398b4a698983a4f45d2
I20260811 12:45:07.813041 22682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:07.823298 22682 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:07.825279 22682 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:07.839727 22682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436: Generated new TSK 0
I20260811 12:45:07.840922 22682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:07.857332 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45451
--builtin_ntp_servers=127.0.186.84:34083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 12:45:08.229535 22694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:08.229849 22694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:08.229951 22694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:08.237740 22694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:08.237864 22694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:08.237983 22694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:45:08.248239 22694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:08.249682 22694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:08.251729 22694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:08.266515 22703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:08.266579 22705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:08.266515 22702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:08.267791 22694 server_base.cc:1034] running on GCE node
I20260811 12:45:08.268474 22694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:08.269662 22694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:08.270889 22694 hybrid_clock.cc:648] HybridClock initialized: now 1786452308270822 us; error 62 us; skew 500 ppm
I20260811 12:45:08.271236 22694 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:08.273968 22694 webserver.cc:460] Webserver started at http://127.0.186.65:35271/ using document root <none> and password file <none>
I20260811 12:45:08.274824 22694 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:08.274921 22694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:08.275230 22694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:08.278503 22694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "73dde29efdd946feb3b0c55d95706ec4"
format_stamp: "Formatted at 2026-08-11 12:45:08 on dist-test-slave-qg60"
server_key: "0b1578e77de95ae095ae7b8af6fb635d"
server_key_iv: "10a5f0ccbdea0f5844c54c2a577959fb"
server_key_version: "encryptionkey@0"
I20260811 12:45:08.279332 22694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "73dde29efdd946feb3b0c55d95706ec4"
format_stamp: "Formatted at 2026-08-11 12:45:08 on dist-test-slave-qg60"
server_key: "0b1578e77de95ae095ae7b8af6fb635d"
server_key_iv: "10a5f0ccbdea0f5844c54c2a577959fb"
server_key_version: "encryptionkey@0"
I20260811 12:45:08.284970 22694 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 12:45:08.288684 22711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:08.290273 22694 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:08.290443 22694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "73dde29efdd946feb3b0c55d95706ec4"
format_stamp: "Formatted at 2026-08-11 12:45:08 on dist-test-slave-qg60"
server_key: "0b1578e77de95ae095ae7b8af6fb635d"
server_key_iv: "10a5f0ccbdea0f5844c54c2a577959fb"
server_key_version: "encryptionkey@0"
I20260811 12:45:08.290711 22694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:08.303543 22694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:08.304430 22694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:08.304859 22694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:08.305907 22694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:08.307430 22694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:08.307523 22694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:08.307613 22694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:08.307672 22694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:08.344784 22694 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:39081
I20260811 12:45:08.344884 22839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:39081 every 8 connection(s)
I20260811 12:45:08.346319 22694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:45:08.355880 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22694
I20260811 12:45:08.356112 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:45:08.356853 745 external_mini_cluster.cc:1428] Setting key 213f52cd57c370cabf8451a0dcd14977
I20260811 12:45:08.360148 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45451
--builtin_ntp_servers=127.0.186.84:34083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 12:45:08.360255 22843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:08.348998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:37693 (local address 127.0.186.126:45451)
0811 12:45:08.349448 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:08.349452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:08.350779 (+ 1327us) server_negotiation.cc:407] Connection header received
0811 12:45:08.352655 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:08.352660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:08.352796 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:08.352922 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:08.354051 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.354858 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.356825 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.357615 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.357773 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:08.359350 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:08.359356 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:08.359360 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:08.359388 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:08.359430 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:08.359442 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:08.359541 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:08.359796 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 12:45:08.359901 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":229,"threads_started":1}
I20260811 12:45:08.361405 22845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:08.349664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45451 (local address 127.0.186.65:37693)
0811 12:45:08.350607 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:08.350660 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:08.352369 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:08.353170 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:08.353178 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:08.353277 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:08.353870 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:08.353887 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.355034 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.355039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:08.356620 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:08.356636 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.357878 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.357886 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:08.358147 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:08.358967 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:08.358973 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:08.359042 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:08.359155 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:08.359543 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:08.359559 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:08.359568 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 12:45:08.359796 (+ 228us) client_negotiation.cc:240] Negotiation successful
0811 12:45:08.360213 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":325,"threads_started":1}
I20260811 12:45:08.363090 22841 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45451
I20260811 12:45:08.363461 22841 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:08.364467 22841 heartbeater.cc:511] Master 127.0.186.126:45451 requested a full tablet report, sending...
I20260811 12:45:08.366910 22629 ts_manager.cc:194] Registered new tserver with Master: 73dde29efdd946feb3b0c55d95706ec4 (127.0.186.65:39081)
I20260811 12:45:08.368443 22629 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.65:37693
W20260811 12:45:08.739185 22846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:08.739590 22846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:08.739692 22846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:08.750502 22846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:08.750649 22846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:08.750820 22846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:45:08.766098 22846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:08.767856 22846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:08.770345 22846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:08.785269 22852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:08.785312 22853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:08.785358 22856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:08.786264 22846 server_base.cc:1034] running on GCE node
I20260811 12:45:08.786993 22846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:08.788125 22846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:08.789366 22846 hybrid_clock.cc:648] HybridClock initialized: now 1786452308789315 us; error 45 us; skew 500 ppm
I20260811 12:45:08.789672 22846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:08.792277 22846 webserver.cc:460] Webserver started at http://127.0.186.66:43119/ using document root <none> and password file <none>
I20260811 12:45:08.793112 22846 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:08.793223 22846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:08.793519 22846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:08.796662 22846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "0224944fd44e4049a3483f2527b5982a"
format_stamp: "Formatted at 2026-08-11 12:45:08 on dist-test-slave-qg60"
server_key: "3fd252093b5e3234c05d858208be8cf1"
server_key_iv: "e58c45bad8986f7546417ae56cc1f927"
server_key_version: "encryptionkey@0"
I20260811 12:45:08.797709 22846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "0224944fd44e4049a3483f2527b5982a"
format_stamp: "Formatted at 2026-08-11 12:45:08 on dist-test-slave-qg60"
server_key: "3fd252093b5e3234c05d858208be8cf1"
server_key_iv: "e58c45bad8986f7546417ae56cc1f927"
server_key_version: "encryptionkey@0"
I20260811 12:45:08.803272 22846 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:08.806932 22863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:08.808388 22846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:45:08.808573 22846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "0224944fd44e4049a3483f2527b5982a"
format_stamp: "Formatted at 2026-08-11 12:45:08 on dist-test-slave-qg60"
server_key: "3fd252093b5e3234c05d858208be8cf1"
server_key_iv: "e58c45bad8986f7546417ae56cc1f927"
server_key_version: "encryptionkey@0"
I20260811 12:45:08.808907 22846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:08.828722 22846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:08.829739 22846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:08.830086 22846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:08.831194 22846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:08.832930 22846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:08.833027 22846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:08.833159 22846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:08.833281 22846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:08.870554 22846 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:39973
I20260811 12:45:08.870616 22989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:39973 every 8 connection(s)
I20260811 12:45:08.872128 22846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:45:08.875674 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22846
I20260811 12:45:08.875876 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:45:08.876524 745 external_mini_cluster.cc:1428] Setting key 15f878231174181eea77afa82294a6db
I20260811 12:45:08.880287 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45451
--builtin_ntp_servers=127.0.186.84:34083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 12:45:08.887997 22994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:08.875303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:47111 (local address 127.0.186.126:45451)
0811 12:45:08.875879 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:08.875886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:08.877456 (+ 1570us) server_negotiation.cc:407] Connection header received
0811 12:45:08.879788 (+ 2332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:08.879797 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:08.879896 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:08.880039 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:08.881497 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.882745 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.884507 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.885249 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.885417 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:08.886942 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:08.886951 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:08.886958 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:08.886987 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:08.887044 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:08.887063 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:08.887165 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:08.887400 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 12:45:08.887529 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":281,"threads_started":1}
I20260811 12:45:08.889142 22996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:08.876002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45451 (local address 127.0.186.66:47111)
0811 12:45:08.877227 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:08.877282 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:08.879468 (+ 2186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:08.880294 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:08.880304 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:08.880456 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:08.881281 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:08.881300 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.882928 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.882932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:08.884341 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:08.884356 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:08.885499 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:08.885505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:08.885731 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:08.886570 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:08.886573 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:08.886617 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:08.886718 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:08.887178 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:08.887188 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:08.887195 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 12:45:08.887362 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 12:45:08.887719 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":343,"threads_started":1}
I20260811 12:45:08.891041 22991 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45451
I20260811 12:45:08.891479 22991 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:08.892347 22991 heartbeater.cc:511] Master 127.0.186.126:45451 requested a full tablet report, sending...
I20260811 12:45:08.894191 22629 ts_manager.cc:194] Registered new tserver with Master: 0224944fd44e4049a3483f2527b5982a (127.0.186.66:39973)
I20260811 12:45:08.895152 22629 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.66:47111
W20260811 12:45:09.252559 22997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:09.252883 22997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:09.252983 22997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:09.260495 22997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:09.260605 22997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:09.260715 22997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:45:09.270414 22997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:34083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:45451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:09.271816 22997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:09.273878 22997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:09.288182 23003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:09.288251 23002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:09.288249 23005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:09.289458 22997 server_base.cc:1034] running on GCE node
I20260811 12:45:09.290086 22997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:09.291152 22997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:09.292382 22997 hybrid_clock.cc:648] HybridClock initialized: now 1786452309292328 us; error 40 us; skew 500 ppm
I20260811 12:45:09.292697 22997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:09.300935 22997 webserver.cc:460] Webserver started at http://127.0.186.67:39939/ using document root <none> and password file <none>
I20260811 12:45:09.301724 22997 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:09.301831 22997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:09.302120 22997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:09.305316 22997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "1de78a3c970b49378455a5bfa240338d"
format_stamp: "Formatted at 2026-08-11 12:45:09 on dist-test-slave-qg60"
server_key: "e27b36b84ef774fe56a32df4a15c942c"
server_key_iv: "c7ad0b39524a5765c4862df1ffed7e48"
server_key_version: "encryptionkey@0"
I20260811 12:45:09.306146 22997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "1de78a3c970b49378455a5bfa240338d"
format_stamp: "Formatted at 2026-08-11 12:45:09 on dist-test-slave-qg60"
server_key: "e27b36b84ef774fe56a32df4a15c942c"
server_key_iv: "c7ad0b39524a5765c4862df1ffed7e48"
server_key_version: "encryptionkey@0"
I20260811 12:45:09.312338 22997 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 12:45:09.316320 23011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:09.317937 22997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:09.318141 22997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "1de78a3c970b49378455a5bfa240338d"
format_stamp: "Formatted at 2026-08-11 12:45:09 on dist-test-slave-qg60"
server_key: "e27b36b84ef774fe56a32df4a15c942c"
server_key_iv: "c7ad0b39524a5765c4862df1ffed7e48"
server_key_version: "encryptionkey@0"
I20260811 12:45:09.318441 22997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:09.347047 22997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:09.347975 22997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:09.348337 22997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:09.349629 22997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:09.351239 22997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:09.351334 22997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:09.351414 22997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:09.351472 22997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:09.372460 22841 heartbeater.cc:503] Master 127.0.186.126:45451 was elected leader, sending a full tablet report...
I20260811 12:45:09.388443 22997 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:34125
I20260811 12:45:09.388581 23133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:34125 every 8 connection(s)
I20260811 12:45:09.389998 22997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:45:09.400484 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 22997
I20260811 12:45:09.400707 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:45:09.401356 745 external_mini_cluster.cc:1428] Setting key c8511c9264dd5ed47c8907de8b76be06
I20260811 12:45:09.405072 23138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.392790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:54447 (local address 127.0.186.126:45451)
0811 12:45:09.393245 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.393250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.394678 (+ 1428us) server_negotiation.cc:407] Connection header received
0811 12:45:09.396814 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.396820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.396927 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.397085 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:09.398352 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.399298 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.401633 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.402232 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.402386 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.404112 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:09.404118 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:09.404123 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:09.404144 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:09.404196 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:09.404213 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:09.404317 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.404557 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.404696 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":220,"threads_started":1}
I20260811 12:45:09.406118 23139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.393446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:45451 (local address 127.0.186.67:54447)
0811 12:45:09.394500 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:09.394544 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:09.396491 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:09.397382 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:09.397391 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:09.397518 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:09.398148 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.398174 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.399485 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.399490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.401417 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.401433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.402537 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.402544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.402839 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.403734 (+ 895us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:09.403738 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:09.403802 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:09.403897 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:09.404325 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:09.404334 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:09.404340 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 12:45:09.404502 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 12:45:09.404975 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":299,"threads_started":1}
I20260811 12:45:09.407500 23136 heartbeater.cc:347] Connected to a master server at 127.0.186.126:45451
I20260811 12:45:09.407800 23136 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:09.408818 23136 heartbeater.cc:511] Master 127.0.186.126:45451 requested a full tablet report, sending...
I20260811 12:45:09.410434 22629 ts_manager.cc:194] Registered new tserver with Master: 1de78a3c970b49378455a5bfa240338d (127.0.186.67:34125)
I20260811 12:45:09.411290 22629 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.67:54447
I20260811 12:45:09.417541 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:45:09.428685 23138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.422048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.0.186.126:45451)
0811 12:45:09.422320 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.422324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.422797 (+ 473us) server_negotiation.cc:407] Connection header received
0811 12:45:09.423036 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.423040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.423110 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.423199 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:09.423814 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.424596 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.426182 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.426612 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.426718 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.428031 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:09.428036 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:09.428039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:09.428059 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:09.428091 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:09.428102 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:09.428225 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.428391 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.428440 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 12:45:09.433487 22629 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:45:09.440642 22629 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:45:09.471446 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.454054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:34125 (local address 127.0.0.1:39184)
0811 12:45:09.462149 (+ 8095us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:09.462165 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:09.463657 (+ 1492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:09.464609 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:09.464614 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:09.464647 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:09.465053 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.465070 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.466981 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.466987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.468982 (+ 1995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.468996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.470384 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.470392 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.470584 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.470648 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 12:45:09.470803 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 12:45:09.471032 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7981,"mutex_wait_us":7,"thread_start_us":7430,"threads_started":1}
I20260811 12:45:09.471433 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.454833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.0.186.67:34125)
0811 12:45:09.461426 (+ 6593us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.461436 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.462681 (+ 1245us) server_negotiation.cc:407] Connection header received
0811 12:45:09.463897 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.463906 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.464129 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.464275 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:09.465273 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.466791 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.469202 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.470165 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.470335 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.470665 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.470868 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.471046 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6394,"thread_start_us":6225,"threads_started":1}
I20260811 12:45:09.472263 23151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.453997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:39973 (local address 127.0.0.1:51462)
0811 12:45:09.462097 (+ 8100us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:09.462154 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:09.462496 (+ 342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:09.463702 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:09.463718 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:09.463762 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:09.464327 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.464345 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.466341 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.466349 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.469050 (+ 2701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.469074 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.471383 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.471390 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.471603 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.471640 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 12:45:09.471735 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 12:45:09.471872 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7650,"mutex_wait_us":2,"thread_start_us":7746,"threads_started":1}
I20260811 12:45:09.473259 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.454182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51462 (local address 127.0.186.66:39973)
0811 12:45:09.461000 (+ 6818us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.461012 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.462295 (+ 1283us) server_negotiation.cc:407] Connection header received
0811 12:45:09.462772 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.462782 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.463070 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.463239 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:09.464581 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.466208 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.469323 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.470835 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.470972 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.471214 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.472633 (+ 1419us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.472858 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6627,"thread_start_us":6463,"threads_started":1}
I20260811 12:45:09.474474 23154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.462968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:39081 (local address 127.0.0.1:44428)
0811 12:45:09.463735 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:09.463756 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:09.463884 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:09.465583 (+ 1699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:09.465588 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:09.465623 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:09.465993 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.466004 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.467921 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.467927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.470242 (+ 2315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.470260 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.473622 (+ 3362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.473630 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.473809 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.473846 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 12:45:09.473934 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 12:45:09.474096 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":22,"spinlock_wait_cycles":11648,"thread_start_us":467,"threads_started":1}
I20260811 12:45:09.475308 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.463098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44428 (local address 127.0.186.65:39081)
0811 12:45:09.465029 (+ 1931us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.465035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.465057 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:45:09.465128 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.465133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.465358 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.465569 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:09.466200 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.467763 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.470500 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.473187 (+ 2687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.474310 (+ 1123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.474628 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.474706 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.474894 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1767,"thread_start_us":1633,"threads_started":1}
I20260811 12:45:09.476150 23061 tablet_service.cc:1467] Processing CreateTablet for tablet 48f0c9b8682b41ecbb2083ea003c0a96 (DEFAULT_TABLE table=test-table [id=65bcb0a8c4b14bad8e511c4b99315422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:09.476950 22918 tablet_service.cc:1467] Processing CreateTablet for tablet 48f0c9b8682b41ecbb2083ea003c0a96 (DEFAULT_TABLE table=test-table [id=65bcb0a8c4b14bad8e511c4b99315422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:09.477892 23061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f0c9b8682b41ecbb2083ea003c0a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:09.478181 22918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f0c9b8682b41ecbb2083ea003c0a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:09.479045 22766 tablet_service.cc:1467] Processing CreateTablet for tablet 48f0c9b8682b41ecbb2083ea003c0a96 (DEFAULT_TABLE table=test-table [id=65bcb0a8c4b14bad8e511c4b99315422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:09.480511 22766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48f0c9b8682b41ecbb2083ea003c0a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:09.492153 23156 tablet_bootstrap.cc:492] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Bootstrap starting.
I20260811 12:45:09.496186 23156 tablet_bootstrap.cc:654] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:09.497839 23156 log.cc:824] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:09.499920 23158 tablet_bootstrap.cc:492] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Bootstrap starting.
I20260811 12:45:09.500895 23157 tablet_bootstrap.cc:492] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Bootstrap starting.
I20260811 12:45:09.501758 23156 tablet_bootstrap.cc:492] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: No bootstrap required, opened a new log
I20260811 12:45:09.502077 23156 ts_tablet_manager.cc:1397] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 12:45:09.503799 23157 tablet_bootstrap.cc:654] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:09.503891 23158 tablet_bootstrap.cc:654] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:09.504958 23157 log.cc:824] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:09.505172 23158 log.cc:824] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:09.511454 23158 tablet_bootstrap.cc:492] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: No bootstrap required, opened a new log
I20260811 12:45:09.511716 23157 tablet_bootstrap.cc:492] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: No bootstrap required, opened a new log
I20260811 12:45:09.511812 23158 ts_tablet_manager.cc:1397] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260811 12:45:09.511998 23157 ts_tablet_manager.cc:1397] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260811 12:45:09.514663 23156 raft_consensus.cc:348] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.515163 23156 raft_consensus.cc:374] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:09.515280 23156 raft_consensus.cc:729] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0224944fd44e4049a3483f2527b5982a, State: Initialized, Role: FOLLOWER
I20260811 12:45:09.515945 23156 consensus_queue.cc:260] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.519505 22991 heartbeater.cc:503] Master 127.0.186.126:45451 was elected leader, sending a full tablet report...
I20260811 12:45:09.520274 23156 ts_tablet_manager.cc:1428] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260811 12:45:09.520459 23158 raft_consensus.cc:348] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.520987 23158 raft_consensus.cc:374] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:09.521090 23158 raft_consensus.cc:729] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73dde29efdd946feb3b0c55d95706ec4, State: Initialized, Role: FOLLOWER
I20260811 12:45:09.523221 23157 raft_consensus.cc:348] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.523692 23157 raft_consensus.cc:374] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:09.523840 23157 raft_consensus.cc:729] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de78a3c970b49378455a5bfa240338d, State: Initialized, Role: FOLLOWER
I20260811 12:45:09.524504 23157 consensus_queue.cc:260] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.525731 23136 heartbeater.cc:503] Master 127.0.186.126:45451 was elected leader, sending a full tablet report...
I20260811 12:45:09.526502 23157 ts_tablet_manager.cc:1428] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260811 12:45:09.527400 23158 consensus_queue.cc:260] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.527971 23164 raft_consensus.cc:482] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:45:09.528280 23164 raft_consensus.cc:504] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.530164 23158 ts_tablet_manager.cc:1428] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Time spent starting tablet: real 0.018s user 0.013s sys 0.006s
I20260811 12:45:09.532465 23164 leader_election.cc:288] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0224944fd44e4049a3483f2527b5982a (127.0.186.66:39973), 1de78a3c970b49378455a5bfa240338d (127.0.186.67:34125)
I20260811 12:45:09.539606 23167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.530858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:39973 (local address 127.0.186.65:42461)
0811 12:45:09.532899 (+ 2041us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:09.532926 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:09.533129 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:09.533702 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:09.533707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:09.533743 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:09.534246 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.534265 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.535598 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.535601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.537681 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.537696 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.539050 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.539054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.539168 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.539193 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 12:45:09.539272 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 12:45:09.539366 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1299,"thread_start_us":1133,"threads_started":1}
I20260811 12:45:09.539728 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.530964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:42461 (local address 127.0.186.66:39973)
0811 12:45:09.531155 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.531161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.533013 (+ 1852us) server_negotiation.cc:407] Connection header received
0811 12:45:09.533356 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.533365 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.533521 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.533656 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:09.534503 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.535466 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.537905 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.538871 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.539039 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.539114 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.539323 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.539458 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:45:09.540863 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.532863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:60717 (local address 127.0.186.67:34125)
0811 12:45:09.533066 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.533075 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.534599 (+ 1524us) server_negotiation.cc:407] Connection header received
0811 12:45:09.534707 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.534713 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.534793 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.534885 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:09.535438 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.536183 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.538606 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.539854 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.540063 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.540136 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.540525 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.540623 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 12:45:09.540946 23168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.532798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:34125 (local address 127.0.186.65:60717)
0811 12:45:09.534483 (+ 1685us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:09.534502 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:09.534613 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:09.534910 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:09.534913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:09.534941 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:09.535274 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.535282 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.536336 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.536341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.538398 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:09.538413 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.540146 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.540150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:09.540346 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.540385 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 12:45:09.540488 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 12:45:09.540618 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1529,"thread_start_us":1319,"threads_started":1}
I20260811 12:45:09.540802 22941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f0c9b8682b41ecbb2083ea003c0a96" candidate_uuid: "73dde29efdd946feb3b0c55d95706ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0224944fd44e4049a3483f2527b5982a" is_pre_election: true
I20260811 12:45:09.541546 22941 raft_consensus.cc:2454] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73dde29efdd946feb3b0c55d95706ec4 in term 0.
I20260811 12:45:09.542124 23086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f0c9b8682b41ecbb2083ea003c0a96" candidate_uuid: "73dde29efdd946feb3b0c55d95706ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de78a3c970b49378455a5bfa240338d" is_pre_election: true
I20260811 12:45:09.542358 22713 leader_election.cc:302] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0224944fd44e4049a3483f2527b5982a, 73dde29efdd946feb3b0c55d95706ec4; no voters:
I20260811 12:45:09.542793 23164 raft_consensus.cc:2781] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:45:09.542752 23086 raft_consensus.cc:2454] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73dde29efdd946feb3b0c55d95706ec4 in term 0.
I20260811 12:45:09.542958 23164 raft_consensus.cc:482] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:45:09.543089 23164 raft_consensus.cc:3037] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:09.545508 23164 raft_consensus.cc:504] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.546082 23164 leader_election.cc:288] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [CANDIDATE]: Term 1 election: Requested vote from peers 0224944fd44e4049a3483f2527b5982a (127.0.186.66:39973), 1de78a3c970b49378455a5bfa240338d (127.0.186.67:34125)
I20260811 12:45:09.546614 23086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f0c9b8682b41ecbb2083ea003c0a96" candidate_uuid: "73dde29efdd946feb3b0c55d95706ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de78a3c970b49378455a5bfa240338d"
I20260811 12:45:09.546602 22941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48f0c9b8682b41ecbb2083ea003c0a96" candidate_uuid: "73dde29efdd946feb3b0c55d95706ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0224944fd44e4049a3483f2527b5982a"
I20260811 12:45:09.546823 23086 raft_consensus.cc:3037] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:09.546851 22941 raft_consensus.cc:3037] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:09.549319 23086 raft_consensus.cc:2454] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73dde29efdd946feb3b0c55d95706ec4 in term 1.
I20260811 12:45:09.549332 22941 raft_consensus.cc:2454] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73dde29efdd946feb3b0c55d95706ec4 in term 1.
I20260811 12:45:09.549796 22713 leader_election.cc:302] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0224944fd44e4049a3483f2527b5982a, 1de78a3c970b49378455a5bfa240338d, 73dde29efdd946feb3b0c55d95706ec4; no voters:
I20260811 12:45:09.550194 23164 raft_consensus.cc:2781] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:09.550369 23164 raft_consensus.cc:686] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 1 LEADER]: Becoming Leader. State: Replica: 73dde29efdd946feb3b0c55d95706ec4, State: Running, Role: LEADER
I20260811 12:45:09.550920 23164 consensus_queue.cc:237] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } }
I20260811 12:45:09.555573 22628 catalog_manager.cc:5495] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73dde29efdd946feb3b0c55d95706ec4 (127.0.186.65). New cstate: current_term: 1 leader_uuid: "73dde29efdd946feb3b0c55d95706ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73dde29efdd946feb3b0c55d95706ec4" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 39081 } health_report { overall_health: HEALTHY } } }
I20260811 12:45:09.596616 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.590661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44430 (local address 127.0.186.65:39081)
0811 12:45:09.590921 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.590927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.590947 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:45:09.591212 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.591217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.591338 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.591466 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:45:09.591924 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.592637 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.594029 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.594543 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.594644 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.595338 (+ 694us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:45:09.595897 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:45:09.596030 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.596242 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.596306 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260811 12:45:09.598989 22842 tablet.cc:2369] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:45:09.606094 22941 raft_consensus.cc:1261] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 1 FOLLOWER]: Refusing update from remote peer 73dde29efdd946feb3b0c55d95706ec4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:09.606112 23086 raft_consensus.cc:1261] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 1 FOLLOWER]: Refusing update from remote peer 73dde29efdd946feb3b0c55d95706ec4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:09.607213 23166 consensus_queue.cc:1035] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0224944fd44e4049a3483f2527b5982a" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:09.607605 23164 consensus_queue.cc:1035] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de78a3c970b49378455a5bfa240338d" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:09.636624 22628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:09.636986 22628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:09.641042 22628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6011547b1fcd4a148ce09f443a35e436: Sending DeleteTablet for 3 replicas of tablet 48f0c9b8682b41ecbb2083ea003c0a96
I20260811 12:45:09.642508 22918 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f0c9b8682b41ecbb2083ea003c0a96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:09 UTC) from {username='slave'} at 127.0.0.1:51462
I20260811 12:45:09.643582 23183 tablet_replica.cc:330] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: stopping tablet replica
I20260811 12:45:09.643625 23061 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f0c9b8682b41ecbb2083ea003c0a96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:09 UTC) from {username='slave'} at 127.0.0.1:39184
I20260811 12:45:09.644068 23183 raft_consensus.cc:2229] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:09.644222 22766 tablet_service.cc:1514] Processing DeleteTablet for tablet 48f0c9b8682b41ecbb2083ea003c0a96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:09 UTC) from {username='slave'} at 127.0.0.1:44428
I20260811 12:45:09.644793 23183 raft_consensus.cc:2258] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:09.645933 23188 tablet_replica.cc:330] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: stopping tablet replica
I20260811 12:45:09.646173 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22694
I20260811 12:45:09.646541 23188 raft_consensus.cc:2229] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:45:09.647419 23188 raft_consensus.cc:2258] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:09.648602 23185 tablet_replica.cc:330] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: stopping tablet replica
I20260811 12:45:09.649101 23185 raft_consensus.cc:2229] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:09.649667 23185 raft_consensus.cc:2258] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:09.650149 23188 ts_tablet_manager.cc:1905] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:09.651798 23185 ts_tablet_manager.cc:1905] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:09.654704 23183 ts_tablet_manager.cc:1905] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:09.658826 23188 ts_tablet_manager.cc:1918] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:09.659060 23188 log.cc:1196] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/48f0c9b8682b41ecbb2083ea003c0a96
I20260811 12:45:09.659189 23185 ts_tablet_manager.cc:1918] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:09.659373 23185 log.cc:1196] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/48f0c9b8682b41ecbb2083ea003c0a96
I20260811 12:45:09.659731 23188 ts_tablet_manager.cc:1939] T 48f0c9b8682b41ecbb2083ea003c0a96 P 73dde29efdd946feb3b0c55d95706ec4: Deleting consensus metadata
I20260811 12:45:09.659937 23185 ts_tablet_manager.cc:1939] T 48f0c9b8682b41ecbb2083ea003c0a96 P 1de78a3c970b49378455a5bfa240338d: Deleting consensus metadata
I20260811 12:45:09.661845 22614 catalog_manager.cc:4841] TS 1de78a3c970b49378455a5bfa240338d (127.0.186.67:34125): tablet 48f0c9b8682b41ecbb2083ea003c0a96 (table test-table [id=65bcb0a8c4b14bad8e511c4b99315422]) successfully deleted
I20260811 12:45:09.662801 23183 ts_tablet_manager.cc:1918] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:09.663010 23183 log.cc:1196] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/48f0c9b8682b41ecbb2083ea003c0a96
I20260811 12:45:09.663383 22614 catalog_manager.cc:4841] TS 73dde29efdd946feb3b0c55d95706ec4 (127.0.186.65:39081): tablet 48f0c9b8682b41ecbb2083ea003c0a96 (table test-table [id=65bcb0a8c4b14bad8e511c4b99315422]) successfully deleted
I20260811 12:45:09.663625 23183 ts_tablet_manager.cc:1939] T 48f0c9b8682b41ecbb2083ea003c0a96 P 0224944fd44e4049a3483f2527b5982a: Deleting consensus metadata
I20260811 12:45:09.665675 22613 catalog_manager.cc:4841] TS 0224944fd44e4049a3483f2527b5982a (127.0.186.66:39973): tablet 48f0c9b8682b41ecbb2083ea003c0a96 (table test-table [id=65bcb0a8c4b14bad8e511c4b99315422]) successfully deleted
I20260811 12:45:09.669055 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.649672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.0.186.65:39081)
0811 12:45:09.650369 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.650375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.653325 (+ 2950us) server_negotiation.cc:407] Connection header received
0811 12:45:09.661173 (+ 7848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.661179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.661300 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.661385 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:09.662204 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.663498 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.665292 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.666030 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.666184 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.667451 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:09.667461 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:09.667474 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:09.668123 (+ 649us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:09.668172 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:09.668193 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:09.668319 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.668497 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.668607 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564}
I20260811 12:45:09.669800 22835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:09.777331 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22694
I20260811 12:45:09.801750 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22846
I20260811 12:45:09.809165 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.802568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51472 (local address 127.0.186.66:39973)
0811 12:45:09.802761 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.802769 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.802856 (+ 87us) server_negotiation.cc:407] Connection header received
0811 12:45:09.803090 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.803094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.803198 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.803314 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:09.803755 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.804542 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.805886 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.806327 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.806465 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.807603 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:09.807612 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:09.807625 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:09.808269 (+ 644us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:09.808327 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:09.808349 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:09.808480 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.808624 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.808763 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 12:45:09.809921 22985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:09.904448 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22846
I20260811 12:45:09.927292 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22997
I20260811 12:45:09.934309 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:09.928185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39192 (local address 127.0.186.67:34125)
0811 12:45:09.928378 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:09.928382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:09.928404 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:45:09.928582 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:09.928586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:09.928676 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:09.928828 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:09.929247 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.930025 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.931336 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:09.931743 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:09.931849 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:09.932931 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:09.932941 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:09.932955 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:09.933556 (+ 601us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:09.933604 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:09.933624 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:09.933717 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:09.933836 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 12:45:09.933932 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:45:09.935011 23129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:10.029479 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22997
I20260811 12:45:10.052575 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 22593
I20260811 12:45:10.053774 22662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:10.167870 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 22593
2026-08-11T12:45:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3002 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:10 dist-test-slave-qg60 krb5kdc[23196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:10 dist-test-slave-qg60 krb5kdc[23196](info): set up 2 sockets
Aug 11 12:45:10 dist-test-slave-qg60 krb5kdc[23196](info): commencing operation
krb5kdc: starting...
W20260811 12:45:11.425202 745 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.006s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:11 dist-test-slave-qg60 krb5kdc[23196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:11.799775 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39005
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39005
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:12.168980 23211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:12.169286 23211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:12.169461 23211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:12.176781 23211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:12.176896 23211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:12.177026 23211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:12.177134 23211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:12.177213 23211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:12.187621 23211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:12.189431 23211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:12.191272 23211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:12.204164 23220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:12.204221 23217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:12.204245 23218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:12.205042 23211 server_base.cc:1034] running on GCE node
I20260811 12:45:12.205900 23211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:12.207521 23211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:12.208834 23211 hybrid_clock.cc:648] HybridClock initialized: now 1786452312208772 us; error 65 us; skew 500 ppm
I20260811 12:45:12.209285 23211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:12 dist-test-slave-qg60 krb5kdc[23196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452312, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:12.212549 23211 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:12.214370 23211 webserver.cc:460] Webserver started at http://127.0.186.126:34457/ using document root <none> and password file <none>
I20260811 12:45:12.215118 23211 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:12.215276 23211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:12.215617 23211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:12.218729 23211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "78bd93329d5d4b7d9f92f09db855072f"
format_stamp: "Formatted at 2026-08-11 12:45:12 on dist-test-slave-qg60"
server_key: "86eda017c1780d8e19896fd7840a81ce"
server_key_iv: "0843c25b4da297943e5b18ce2aad26bb"
server_key_version: "encryptionkey@0"
I20260811 12:45:12.219579 23211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "78bd93329d5d4b7d9f92f09db855072f"
format_stamp: "Formatted at 2026-08-11 12:45:12 on dist-test-slave-qg60"
server_key: "86eda017c1780d8e19896fd7840a81ce"
server_key_iv: "0843c25b4da297943e5b18ce2aad26bb"
server_key_version: "encryptionkey@0"
I20260811 12:45:12.225176 23211 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 12:45:12.229156 23227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:12.230615 23211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:12.230836 23211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "78bd93329d5d4b7d9f92f09db855072f"
format_stamp: "Formatted at 2026-08-11 12:45:12 on dist-test-slave-qg60"
server_key: "86eda017c1780d8e19896fd7840a81ce"
server_key_iv: "0843c25b4da297943e5b18ce2aad26bb"
server_key_version: "encryptionkey@0"
I20260811 12:45:12.231159 23211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:12.249111 23211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:12.253885 23211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:12.254211 23211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:12.273628 23211 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39005
I20260811 12:45:12.273672 23287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39005 every 8 connection(s)
I20260811 12:45:12.275126 23211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:12.277339 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 23211
I20260811 12:45:12.277551 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:12.278190 745 external_mini_cluster.cc:1428] Setting key acc78a3deb5227a433a345fdae20abe4
I20260811 12:45:12.279834 23288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:45:12 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:12.294945 23288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f: Bootstrap starting.
I20260811 12:45:12.299582 23288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:12.300981 23288 log.cc:824] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:12.304335 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:12.280376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60788 (local address 127.0.186.126:39005)
0811 12:45:12.281248 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:12.281260 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:12.281301 (+ 41us) server_negotiation.cc:407] Connection header received
0811 12:45:12.282907 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:12.282928 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:12.283318 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:12.283658 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:12.285743 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:12.287097 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:12.288988 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:12.289696 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:12.289824 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:12.294941 (+ 5117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:12.294952 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:12.294974 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:12.295034 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:12.299165 (+ 4131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:12.300125 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:12.300142 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:12.300151 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:12.300372 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:12.300813 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:12.300818 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:12.300821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:12.301602 (+ 781us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:12.301922 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:12.302445 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 12:45:12.302923 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":402,"threads_started":1}
I20260811 12:45:12.304951 23288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f: No bootstrap required, opened a new log
I20260811 12:45:12.313722 23288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bd93329d5d4b7d9f92f09db855072f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39005 } }
I20260811 12:45:12.314239 23288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:12.314383 23288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bd93329d5d4b7d9f92f09db855072f, State: Initialized, Role: FOLLOWER
I20260811 12:45:12.315079 23288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bd93329d5d4b7d9f92f09db855072f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39005 } }
I20260811 12:45:12.315330 23288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:12.315480 23288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:12.315663 23288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:12.318084 23288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bd93329d5d4b7d9f92f09db855072f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39005 } }
I20260811 12:45:12.318643 23288 leader_election.cc:302] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78bd93329d5d4b7d9f92f09db855072f; no voters:
I20260811 12:45:12.319305 23288 leader_election.cc:288] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:12.319514 23294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:12.321044 23294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [term 1 LEADER]: Becoming Leader. State: Replica: 78bd93329d5d4b7d9f92f09db855072f, State: Running, Role: LEADER
I20260811 12:45:12.321772 23288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:12.321730 23294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bd93329d5d4b7d9f92f09db855072f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39005 } }
I20260811 12:45:12.324981 23296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78bd93329d5d4b7d9f92f09db855072f. Latest consensus state: current_term: 1 leader_uuid: "78bd93329d5d4b7d9f92f09db855072f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bd93329d5d4b7d9f92f09db855072f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39005 } } }
I20260811 12:45:12.325451 23296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:12.325328 23295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78bd93329d5d4b7d9f92f09db855072f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78bd93329d5d4b7d9f92f09db855072f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39005 } } }
I20260811 12:45:12.325645 23295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:12.327119 23304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:12.331912 23304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:12.342065 23304 catalog_manager.cc:1347] Generated new cluster ID: c3a874c31f3b4277b8d9ff4be2f8215f
I20260811 12:45:12.342231 23304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:12.376277 23304 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:12.377796 23304 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:12.384817 23304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f: Generated new TSK 0
I20260811 12:45:12.385713 23304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
Entry for principal kudu/127.0.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab.
I20260811 12:45:12.468974 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39005
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:12.838256 23316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:12.838572 23316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:12.838673 23316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:12.846886 23316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:12.847141 23316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:12.847354 23316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:45:12.859161 23316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.65.keytab
--principal=kudu/127.0.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:12.860608 23316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:12.862102 23316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:12.876209 23324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:12.876683 23327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:12.877048 23323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:12.877331 23316 server_base.cc:1034] running on GCE node
I20260811 12:45:12.878016 23316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:12.879065 23316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:12.880333 23316 hybrid_clock.cc:648] HybridClock initialized: now 1786452312880284 us; error 45 us; skew 500 ppm
I20260811 12:45:12.880710 23316 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:12 dist-test-slave-qg60 krb5kdc[23196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452312, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:12.884305 23316 init.cc:377] Logged in from keytab as kudu/127.0.186.65@KRBTEST.COM (short username kudu)
I20260811 12:45:12.886124 23316 webserver.cc:460] Webserver started at http://127.0.186.65:35963/ using document root <none> and password file <none>
I20260811 12:45:12.886895 23316 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:12.887089 23316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:12.887482 23316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:12.890746 23316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "6555d71b501f41c3b7e074bd4ae101bc"
format_stamp: "Formatted at 2026-08-11 12:45:12 on dist-test-slave-qg60"
server_key: "6eb5d7d0b048ce7393ba469f71e87670"
server_key_iv: "5ba6e07c7cd3ace76fe035dde2ebfb66"
server_key_version: "encryptionkey@0"
I20260811 12:45:12.891561 23316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "6555d71b501f41c3b7e074bd4ae101bc"
format_stamp: "Formatted at 2026-08-11 12:45:12 on dist-test-slave-qg60"
server_key: "6eb5d7d0b048ce7393ba469f71e87670"
server_key_iv: "5ba6e07c7cd3ace76fe035dde2ebfb66"
server_key_version: "encryptionkey@0"
I20260811 12:45:12.897290 23316 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 12:45:12.900962 23335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:12.902359 23316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:12.902554 23316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "6555d71b501f41c3b7e074bd4ae101bc"
format_stamp: "Formatted at 2026-08-11 12:45:12 on dist-test-slave-qg60"
server_key: "6eb5d7d0b048ce7393ba469f71e87670"
server_key_iv: "5ba6e07c7cd3ace76fe035dde2ebfb66"
server_key_version: "encryptionkey@0"
I20260811 12:45:12.902791 23316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:12.927007 23316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:12.931561 23316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:12.931874 23316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:12.933079 23316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:12.934459 23316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:12.934571 23316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:12.934723 23316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:12.934854 23316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:12.981534 23316 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:38439
I20260811 12:45:12.981670 23459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:38439 every 8 connection(s)
I20260811 12:45:12.982966 23316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:45:12.987893 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 23316
I20260811 12:45:12.988083 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:45:12.988529 745 external_mini_cluster.cc:1428] Setting key 449ffdfa9a62e459b9906cb55bc25c5a
Aug 11 12:45:12 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452312, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.65@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:13.019357 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:12.986210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:49371 (local address 127.0.186.126:39005)
0811 12:45:12.986748 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:12.986755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:12.989152 (+ 2397us) server_negotiation.cc:407] Connection header received
0811 12:45:12.991533 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:12.991540 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:12.991632 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:12.991755 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:12.994308 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:12.995434 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:12.998441 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:12.999135 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:12.999310 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:13.004822 (+ 5512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:13.004832 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:13.004839 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:13.004897 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:13.014347 (+ 9450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:13.015855 (+ 1508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:13.015864 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:13.015871 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:13.016102 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:13.016799 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:13.016808 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:13.016815 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:13.017269 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:13.017482 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:13.018484 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0811 12:45:13.018804 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":260,"threads_started":1}
I20260811 12:45:13.020298 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:12.986752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39005 (local address 127.0.186.65:49371)
0811 12:45:12.987843 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:12.987917 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:12.991157 (+ 3240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:12.992086 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:12.992101 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:12.993089 (+ 988us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:12.994062 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:12.994104 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:12.995651 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:12.995659 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:12.998253 (+ 2594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:12.998277 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:12.999449 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:12.999461 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:12.999812 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:13.000778 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:45:13.000822 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:13.004418 (+ 3596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:13.014585 (+ 10167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:13.014599 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:13.014621 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:13.015409 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:13.016286 (+ 877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:13.016292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:13.016296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:13.016598 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:13.017447 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:13.017457 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:13.017957 (+ 500us) client_negotiation.cc:769] Sending connection context
0811 12:45:13.018279 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 12:45:13.018872 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":467,"threads_started":1}
I20260811 12:45:13.022135 23460 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39005
I20260811 12:45:13.022554 23460 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:13.023622 23460 heartbeater.cc:511] Master 127.0.186.126:39005 requested a full tablet report, sending...
I20260811 12:45:13.026338 23247 ts_manager.cc:194] Registered new tserver with Master: 6555d71b501f41c3b7e074bd4ae101bc (127.0.186.65:38439)
I20260811 12:45:13.028036 23247 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.65@KRBTEST.COM'} at 127.0.186.65:49371
WARNING: no policy specified for kudu/127.0.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
Entry for principal kudu/127.0.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab.
I20260811 12:45:13.081559 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39005
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:13.448078 23467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:13.448376 23467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:13.448540 23467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:13.456214 23467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:13.456348 23467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:13.456524 23467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:45:13.467667 23467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.66.keytab
--principal=kudu/127.0.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:13.469234 23467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:13.470736 23467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:13.485448 23475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:13.485530 23472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:13.485507 23473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:13.486843 23467 server_base.cc:1034] running on GCE node
I20260811 12:45:13.487557 23467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:13.488718 23467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:13.490015 23467 hybrid_clock.cc:648] HybridClock initialized: now 1786452313489983 us; error 79 us; skew 500 ppm
I20260811 12:45:13.490396 23467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:13 dist-test-slave-qg60 krb5kdc[23196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452313, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:13.493989 23467 init.cc:377] Logged in from keytab as kudu/127.0.186.66@KRBTEST.COM (short username kudu)
I20260811 12:45:13.495743 23467 webserver.cc:460] Webserver started at http://127.0.186.66:43465/ using document root <none> and password file <none>
I20260811 12:45:13.496524 23467 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:13.496685 23467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:13.497058 23467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:13.500360 23467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "2330312d8a4a40a3ba1fe946105b9986"
format_stamp: "Formatted at 2026-08-11 12:45:13 on dist-test-slave-qg60"
server_key: "8672986287c92bc32f00a9c3bebc28b3"
server_key_iv: "b7abce431f556400395fd633ff7c0426"
server_key_version: "encryptionkey@0"
I20260811 12:45:13.501308 23467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "2330312d8a4a40a3ba1fe946105b9986"
format_stamp: "Formatted at 2026-08-11 12:45:13 on dist-test-slave-qg60"
server_key: "8672986287c92bc32f00a9c3bebc28b3"
server_key_iv: "b7abce431f556400395fd633ff7c0426"
server_key_version: "encryptionkey@0"
I20260811 12:45:13.507041 23467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:13.511194 23483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:13.512777 23467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:45:13.512969 23467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "2330312d8a4a40a3ba1fe946105b9986"
format_stamp: "Formatted at 2026-08-11 12:45:13 on dist-test-slave-qg60"
server_key: "8672986287c92bc32f00a9c3bebc28b3"
server_key_iv: "b7abce431f556400395fd633ff7c0426"
server_key_version: "encryptionkey@0"
I20260811 12:45:13.513229 23467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:13.541245 23467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:13.545941 23467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:13.546304 23467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:13.547433 23467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:13.549017 23467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:13.549139 23467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:13.549297 23467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:13.549396 23467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:13.586063 23467 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:38379
I20260811 12:45:13.586066 23609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:38379 every 8 connection(s)
I20260811 12:45:13.587464 23467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:45:13.590641 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 23467
I20260811 12:45:13.590847 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:45:13.591590 745 external_mini_cluster.cc:1428] Setting key ac58b248ade301e9052a83e994960299
Aug 11 12:45:13 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452313, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.66@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:13.609681 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:13.590264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:50657 (local address 127.0.186.126:39005)
0811 12:45:13.590844 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:13.590851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:13.592312 (+ 1461us) server_negotiation.cc:407] Connection header received
0811 12:45:13.594702 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:13.594708 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:13.594793 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:13.594925 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:13.596526 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:13.597353 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:13.598977 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:13.599422 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:13.599562 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:13.603395 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:13.603400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:13.603403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:13.603438 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:13.606187 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:13.607051 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:13.607056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:13.607066 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:13.607204 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:13.607686 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:13.607694 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:13.607698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:13.608001 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:13.608195 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:13.608998 (+ 803us) server_negotiation.cc:299] Negotiation successful
0811 12:45:13.609260 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":257,"threads_started":1}
I20260811 12:45:13.610841 23613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:13.590887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39005 (local address 127.0.186.66:50657)
0811 12:45:13.592107 (+ 1220us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:13.592168 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:13.594387 (+ 2219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:13.595189 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:13.595197 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:13.595747 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:13.596335 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:13.596352 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:13.597528 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:13.597535 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:13.598807 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:13.598820 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:13.599680 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:13.599688 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:13.599932 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:13.600714 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:45:13.600794 (+ 80us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:13.603135 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:13.606364 (+ 3229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:13.606374 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:13.606421 (+ 47us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:13.606908 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:13.607328 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:13.607333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:13.607337 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:13.607552 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:13.608146 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:13.608156 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:13.608543 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 12:45:13.608909 (+ 366us) client_negotiation.cc:240] Negotiation successful
0811 12:45:13.609507 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"thread_start_us":454,"threads_started":1}
I20260811 12:45:13.612525 23610 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39005
I20260811 12:45:13.612937 23610 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:13.613739 23610 heartbeater.cc:511] Master 127.0.186.126:39005 requested a full tablet report, sending...
I20260811 12:45:13.615285 23247 ts_manager.cc:194] Registered new tserver with Master: 2330312d8a4a40a3ba1fe946105b9986 (127.0.186.66:38379)
I20260811 12:45:13.616227 23247 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.66@KRBTEST.COM'} at 127.0.186.66:50657
WARNING: no policy specified for kudu/127.0.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
Entry for principal kudu/127.0.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab.
I20260811 12:45:13.673331 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39005
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:45:14.032460 23460 heartbeater.cc:503] Master 127.0.186.126:39005 was elected leader, sending a full tablet report...
W20260811 12:45:14.045776 23616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:14.046162 23616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:14.046351 23616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:14.054235 23616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:14.054415 23616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:14.054620 23616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:45:14.065073 23616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/krb5kdc/kudu_127.0.186.67.keytab
--principal=kudu/127.0.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:39005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:14.066520 23616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:14.067922 23616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:14.082198 23621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:14.082479 23624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:14.082270 23622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:14.083675 23616 server_base.cc:1034] running on GCE node
I20260811 12:45:14.084432 23616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:14.085589 23616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:14.086807 23616 hybrid_clock.cc:648] HybridClock initialized: now 1786452314086754 us; error 50 us; skew 500 ppm
I20260811 12:45:14.087159 23616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:14 dist-test-slave-qg60 krb5kdc[23196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452314, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:14.090931 23616 init.cc:377] Logged in from keytab as kudu/127.0.186.67@KRBTEST.COM (short username kudu)
I20260811 12:45:14.092612 23616 webserver.cc:460] Webserver started at http://127.0.186.67:45007/ using document root <none> and password file <none>
I20260811 12:45:14.093387 23616 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:14.093508 23616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:14.093801 23616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:14.097044 23616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "bdbe92a689f441569a916aebf5652b50"
format_stamp: "Formatted at 2026-08-11 12:45:14 on dist-test-slave-qg60"
server_key: "918ffb22bd4a5ab50ef04f9857ceed62"
server_key_iv: "d63f1403e1eaf4f773c92972215e8cc2"
server_key_version: "encryptionkey@0"
I20260811 12:45:14.097828 23616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "bdbe92a689f441569a916aebf5652b50"
format_stamp: "Formatted at 2026-08-11 12:45:14 on dist-test-slave-qg60"
server_key: "918ffb22bd4a5ab50ef04f9857ceed62"
server_key_iv: "d63f1403e1eaf4f773c92972215e8cc2"
server_key_version: "encryptionkey@0"
I20260811 12:45:14.103622 23616 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:14.107540 23633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:14.109272 23616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 12:45:14.109463 23616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "bdbe92a689f441569a916aebf5652b50"
format_stamp: "Formatted at 2026-08-11 12:45:14 on dist-test-slave-qg60"
server_key: "918ffb22bd4a5ab50ef04f9857ceed62"
server_key_iv: "d63f1403e1eaf4f773c92972215e8cc2"
server_key_version: "encryptionkey@0"
I20260811 12:45:14.109690 23616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:14.130267 23616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:14.135514 23616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:14.135864 23616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:14.137068 23616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:14.138583 23616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:14.138674 23616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:14.138857 23616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:14.138912 23616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:14.174170 23616 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:39935
I20260811 12:45:14.174238 23758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:39935 every 8 connection(s)
I20260811 12:45:14.175544 23616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:45:14.182754 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 23616
I20260811 12:45:14.182981 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:45:14.183589 745 external_mini_cluster.cc:1428] Setting key bba5d1089760709f24da65b27de4c748
Aug 11 12:45:14 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452314, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.67@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:14.198781 23762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.178290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:50629 (local address 127.0.186.126:39005)
0811 12:45:14.178800 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.178805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.179806 (+ 1001us) server_negotiation.cc:407] Connection header received
0811 12:45:14.181780 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.181785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.181873 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.181977 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:14.184217 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.185272 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.187455 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.188028 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.188135 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.191784 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:14.191790 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:14.191793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:14.191829 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:14.195043 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.195957 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.195961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.195963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.196135 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.196606 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.196609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.196611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.196955 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:14.197163 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.198078 (+ 915us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.198313 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":255,"threads_started":1}
I20260811 12:45:14.199970 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.178880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39005 (local address 127.0.186.67:50629)
0811 12:45:14.179632 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:14.179674 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:14.181513 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:14.182197 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:14.182205 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:14.183093 (+ 888us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:14.183940 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.183969 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.185460 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.185467 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.187224 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.187237 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.188244 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.188250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.188445 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.189227 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:45:14.189255 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:14.191546 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:14.195237 (+ 3691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:14.195252 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:14.195273 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:14.195831 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:14.196277 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:45:14.196281 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:45:14.196283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:45:14.196496 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:45:14.197118 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:14.197125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:14.197567 (+ 442us) client_negotiation.cc:769] Sending connection context
0811 12:45:14.197916 (+ 349us) client_negotiation.cc:240] Negotiation successful
0811 12:45:14.198534 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":283,"threads_started":1}
I20260811 12:45:14.201501 23759 heartbeater.cc:347] Connected to a master server at 127.0.186.126:39005
I20260811 12:45:14.201881 23759 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:14.202700 23759 heartbeater.cc:511] Master 127.0.186.126:39005 requested a full tablet report, sending...
I20260811 12:45:14.204236 23247 ts_manager.cc:194] Registered new tserver with Master: bdbe92a689f441569a916aebf5652b50 (127.0.186.67:39935)
I20260811 12:45:14.205118 23247 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.186.67@KRBTEST.COM'} at 127.0.186.67:50629
I20260811 12:45:14.212265 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:45:14.230707 23762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.216857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57398 (local address 127.0.186.126:39005)
0811 12:45:14.217168 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.217175 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.217466 (+ 291us) server_negotiation.cc:407] Connection header received
0811 12:45:14.217709 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.217718 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.217782 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.217910 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:14.219370 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.220102 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.221561 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.221999 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.222200 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.224896 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:14.224901 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:14.224904 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:14.224940 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:14.227803 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.228509 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.228519 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.228521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.228642 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.229081 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.229088 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.229095 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.229447 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:14.229707 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.230098 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.230353 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:45:14.234992 23247 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:45:14.242388 23247 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:45:14.282600 23774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.255062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:38439 (local address 127.0.0.1:40338)
0811 12:45:14.262535 (+ 7473us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:14.262598 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:14.262904 (+ 306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:14.271370 (+ 8466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:14.271377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:14.271433 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:14.272048 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.272069 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.275373 (+ 3304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.275383 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.278678 (+ 3295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.278698 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.281223 (+ 2525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.281231 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.281551 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.281637 (+ 86us) client_negotiation.cc:769] Sending connection context
0811 12:45:14.281774 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 12:45:14.282037 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7094,"mutex_wait_us":120,"spinlock_wait_cycles":384,"thread_start_us":620,"threads_started":1}
I20260811 12:45:14.283254 23778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.256541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:39935 (local address 127.0.0.1:43234)
0811 12:45:14.268720 (+ 12179us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:14.268761 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:14.268935 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:14.271370 (+ 2435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:14.271377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:14.271437 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:14.272228 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.272244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.276460 (+ 4216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.276466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.279204 (+ 2738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.279220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.281872 (+ 2652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.281879 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.282094 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.282128 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 12:45:14.282218 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 12:45:14.282365 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12001,"mutex_wait_us":43,"spinlock_wait_cycles":24192,"thread_start_us":12501,"threads_started":1}
I20260811 12:45:14.283877 23775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.255389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40338 (local address 127.0.186.65:38439)
0811 12:45:14.270748 (+ 15359us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.270758 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.270792 (+ 34us) server_negotiation.cc:407] Connection header received
0811 12:45:14.270899 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.270907 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.271110 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.272342 (+ 1232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:14.272674 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.275069 (+ 2395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.279036 (+ 3967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.280914 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.282999 (+ 2085us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.283250 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.283341 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.283527 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15147,"thread_start_us":14900,"threads_started":1}
I20260811 12:45:14.284098 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.257149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43234 (local address 127.0.186.67:39935)
0811 12:45:14.270107 (+ 12958us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.270118 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.270164 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:45:14.270819 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.270831 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.271092 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.272443 (+ 1351us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:14.273189 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.276257 (+ 3068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.279420 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.281578 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.283067 (+ 1489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.283379 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.283483 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.283702 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12653,"thread_start_us":12351,"threads_started":1}
I20260811 12:45:14.287207 23776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.255868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:38379 (local address 127.0.0.1:34192)
0811 12:45:14.268041 (+ 12173us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:14.268070 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:14.268236 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:14.270933 (+ 2697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:14.270942 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:14.270989 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:14.271423 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.271444 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.281134 (+ 9690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.281139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.283877 (+ 2738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.283905 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.286338 (+ 2433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.286345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.286537 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.286578 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 12:45:14.286680 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 12:45:14.286830 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11995,"thread_start_us":11392,"threads_started":1}
I20260811 12:45:14.288075 23777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.256166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.0.186.66:38379)
0811 12:45:14.269749 (+ 13583us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.269764 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.269810 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:45:14.269954 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.269968 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.270335 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.270559 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:14.271676 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.280952 (+ 9276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.284139 (+ 3187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.285745 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.285871 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.286101 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.287531 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.287726 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13320,"thread_start_us":13698,"threads_started":1}
I20260811 12:45:14.288568 23686 tablet_service.cc:1467] Processing CreateTablet for tablet bf222133e12842b099082039d1314552 (DEFAULT_TABLE table=test-table [id=cb3fcfd8c7ca4501811a7f1d4f16bc36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:14.289158 23388 tablet_service.cc:1467] Processing CreateTablet for tablet bf222133e12842b099082039d1314552 (DEFAULT_TABLE table=test-table [id=cb3fcfd8c7ca4501811a7f1d4f16bc36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:14.290609 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf222133e12842b099082039d1314552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:14.290701 23388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf222133e12842b099082039d1314552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:14.292145 23536 tablet_service.cc:1467] Processing CreateTablet for tablet bf222133e12842b099082039d1314552 (DEFAULT_TABLE table=test-table [id=cb3fcfd8c7ca4501811a7f1d4f16bc36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:14.294689 23536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf222133e12842b099082039d1314552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:14.305190 23780 tablet_bootstrap.cc:492] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Bootstrap starting.
I20260811 12:45:14.307559 23781 tablet_bootstrap.cc:492] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Bootstrap starting.
I20260811 12:45:14.310022 23780 tablet_bootstrap.cc:654] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:14.311518 23782 tablet_bootstrap.cc:492] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Bootstrap starting.
I20260811 12:45:14.311636 23780 log.cc:824] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:14.311755 23781 tablet_bootstrap.cc:654] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:14.313300 23781 log.cc:824] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:14.315356 23782 tablet_bootstrap.cc:654] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:14.316175 23780 tablet_bootstrap.cc:492] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: No bootstrap required, opened a new log
I20260811 12:45:14.316399 23782 log.cc:824] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:14.316517 23780 ts_tablet_manager.cc:1397] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 12:45:14.316938 23781 tablet_bootstrap.cc:492] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: No bootstrap required, opened a new log
I20260811 12:45:14.317312 23781 ts_tablet_manager.cc:1397] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 12:45:14.319216 23782 tablet_bootstrap.cc:492] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: No bootstrap required, opened a new log
I20260811 12:45:14.319482 23782 ts_tablet_manager.cc:1397] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260811 12:45:14.327495 23782 raft_consensus.cc:348] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.327929 23782 raft_consensus.cc:374] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:14.328114 23782 raft_consensus.cc:729] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2330312d8a4a40a3ba1fe946105b9986, State: Initialized, Role: FOLLOWER
I20260811 12:45:14.328826 23782 consensus_queue.cc:260] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.329519 23780 raft_consensus.cc:348] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.330044 23780 raft_consensus.cc:374] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:14.330071 23610 heartbeater.cc:503] Master 127.0.186.126:39005 was elected leader, sending a full tablet report...
I20260811 12:45:14.330189 23780 raft_consensus.cc:729] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe92a689f441569a916aebf5652b50, State: Initialized, Role: FOLLOWER
I20260811 12:45:14.330823 23782 ts_tablet_manager.cc:1428] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Time spent starting tablet: real 0.011s user 0.004s sys 0.007s
I20260811 12:45:14.330869 23780 consensus_queue.cc:260] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.329553 23781 raft_consensus.cc:348] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.331969 23781 raft_consensus.cc:374] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:14.332158 23781 raft_consensus.cc:729] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6555d71b501f41c3b7e074bd4ae101bc, State: Initialized, Role: FOLLOWER
I20260811 12:45:14.332373 23759 heartbeater.cc:503] Master 127.0.186.126:39005 was elected leader, sending a full tablet report...
I20260811 12:45:14.333007 23781 consensus_queue.cc:260] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.333407 23780 ts_tablet_manager.cc:1428] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260811 12:45:14.336234 23781 ts_tablet_manager.cc:1428] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Time spent starting tablet: real 0.019s user 0.016s sys 0.000s
W20260811 12:45:14.339720 23611 tablet.cc:2369] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:14.427417 23761 tablet.cc:2369] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:14.486200 23462 tablet.cc:2369] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:45:14.668787 23788 raft_consensus.cc:482] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:45:14.669198 23788 raft_consensus.cc:504] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.671217 23788 leader_election.cc:288] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe92a689f441569a916aebf5652b50 (127.0.186.67:39935), 2330312d8a4a40a3ba1fe946105b9986 (127.0.186.66:38379)
I20260811 12:45:14.679412 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.671782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:39029 (local address 127.0.186.67:39935)
0811 12:45:14.671997 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.672004 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.673029 (+ 1025us) server_negotiation.cc:407] Connection header received
0811 12:45:14.673286 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.673291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.673355 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.673459 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:14.674222 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.674962 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.677419 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.678291 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.678511 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.678596 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.678968 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.679100 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:45:14.679559 23790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.671462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:39935 (local address 127.0.186.65:39029)
0811 12:45:14.672872 (+ 1410us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:14.672899 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:14.673113 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:14.673477 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:14.673482 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:14.673509 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:14.674033 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.674050 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.675109 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.675115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.677225 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.677243 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.678522 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.678529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.678742 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.678784 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 12:45:14.678910 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 12:45:14.679061 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1211,"mutex_wait_us":77,"spinlock_wait_cycles":23936,"thread_start_us":1188,"threads_started":1}
I20260811 12:45:14.679677 23777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.672389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:47479 (local address 127.0.186.66:38379)
0811 12:45:14.672616 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.672623 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.673128 (+ 505us) server_negotiation.cc:407] Connection header received
0811 12:45:14.673351 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.673355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.673417 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.673539 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:14.674287 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.675010 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.677617 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.678649 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.678849 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.678950 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.679240 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.679377 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 12:45:14.679658 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.671840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:38379 (local address 127.0.186.65:47479)
0811 12:45:14.673003 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:14.673022 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:14.673199 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:14.673544 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:14.673549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:14.673578 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:14.674102 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.674112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.675174 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.675188 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.677413 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:14.677432 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.678896 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.678904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:14.679056 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.679085 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 12:45:14.679190 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 12:45:14.679334 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1050,"thread_start_us":548,"threads_started":1}
I20260811 12:45:14.681048 23706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf222133e12842b099082039d1314552" candidate_uuid: "6555d71b501f41c3b7e074bd4ae101bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe92a689f441569a916aebf5652b50" is_pre_election: true
I20260811 12:45:14.681005 23557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf222133e12842b099082039d1314552" candidate_uuid: "6555d71b501f41c3b7e074bd4ae101bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2330312d8a4a40a3ba1fe946105b9986" is_pre_election: true
I20260811 12:45:14.681612 23706 raft_consensus.cc:2454] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6555d71b501f41c3b7e074bd4ae101bc in term 0.
I20260811 12:45:14.681627 23557 raft_consensus.cc:2454] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6555d71b501f41c3b7e074bd4ae101bc in term 0.
I20260811 12:45:14.682374 23337 leader_election.cc:302] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2330312d8a4a40a3ba1fe946105b9986, 6555d71b501f41c3b7e074bd4ae101bc; no voters:
I20260811 12:45:14.682840 23788 raft_consensus.cc:2781] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:45:14.683036 23788 raft_consensus.cc:482] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:45:14.683158 23788 raft_consensus.cc:3037] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:14.685568 23788 raft_consensus.cc:504] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.686262 23788 leader_election.cc:288] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [CANDIDATE]: Term 1 election: Requested vote from peers bdbe92a689f441569a916aebf5652b50 (127.0.186.67:39935), 2330312d8a4a40a3ba1fe946105b9986 (127.0.186.66:38379)
I20260811 12:45:14.686793 23706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf222133e12842b099082039d1314552" candidate_uuid: "6555d71b501f41c3b7e074bd4ae101bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe92a689f441569a916aebf5652b50"
I20260811 12:45:14.686861 23557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf222133e12842b099082039d1314552" candidate_uuid: "6555d71b501f41c3b7e074bd4ae101bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2330312d8a4a40a3ba1fe946105b9986"
I20260811 12:45:14.687043 23706 raft_consensus.cc:3037] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:14.687215 23557 raft_consensus.cc:3037] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:14.689565 23706 raft_consensus.cc:2454] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6555d71b501f41c3b7e074bd4ae101bc in term 1.
I20260811 12:45:14.689788 23557 raft_consensus.cc:2454] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6555d71b501f41c3b7e074bd4ae101bc in term 1.
I20260811 12:45:14.690097 23339 leader_election.cc:302] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6555d71b501f41c3b7e074bd4ae101bc, bdbe92a689f441569a916aebf5652b50; no voters:
I20260811 12:45:14.690480 23788 raft_consensus.cc:2781] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:14.691039 23788 raft_consensus.cc:686] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 1 LEADER]: Becoming Leader. State: Replica: 6555d71b501f41c3b7e074bd4ae101bc, State: Running, Role: LEADER
I20260811 12:45:14.691533 23788 consensus_queue.cc:237] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } }
I20260811 12:45:14.696337 23245 catalog_manager.cc:5495] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6555d71b501f41c3b7e074bd4ae101bc (127.0.186.65). New cstate: current_term: 1 leader_uuid: "6555d71b501f41c3b7e074bd4ae101bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6555d71b501f41c3b7e074bd4ae101bc" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 } health_report { overall_health: UNKNOWN } } }
I20260811 12:45:14.744434 23775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.737599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40350 (local address 127.0.186.65:38439)
0811 12:45:14.737808 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.737813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.738203 (+ 390us) server_negotiation.cc:407] Connection header received
0811 12:45:14.738403 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.738406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.738496 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.738651 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:45:14.739108 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.739861 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.741370 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.741814 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.741948 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.742703 (+ 755us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:45:14.743553 (+ 850us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:45:14.743741 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.743940 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.744061 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 12:45:14.756134 23557 raft_consensus.cc:1261] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 1 FOLLOWER]: Refusing update from remote peer 6555d71b501f41c3b7e074bd4ae101bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:14.756176 23706 raft_consensus.cc:1261] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 1 FOLLOWER]: Refusing update from remote peer 6555d71b501f41c3b7e074bd4ae101bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:14.757454 23788 consensus_queue.cc:1035] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2330312d8a4a40a3ba1fe946105b9986" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:14.757823 23791 consensus_queue.cc:1035] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe92a689f441569a916aebf5652b50" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 39935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:14.772238 23797 mvcc.cc:205] Tried to move back new op lower bound from 7317308681227866112 to 7317308680980271104. Current Snapshot: MvccSnapshot[applied={T|T < 7317308681227866112}]
I20260811 12:45:14.785246 23247 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:14.785548 23247 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:14.789615 23247 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 78bd93329d5d4b7d9f92f09db855072f: Sending DeleteTablet for 3 replicas of tablet bf222133e12842b099082039d1314552
I20260811 12:45:14.790987 23388 tablet_service.cc:1514] Processing DeleteTablet for tablet bf222133e12842b099082039d1314552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:14 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:40338
I20260811 12:45:14.791124 23686 tablet_service.cc:1514] Processing DeleteTablet for tablet bf222133e12842b099082039d1314552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:14 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:43234
I20260811 12:45:14.792163 23806 tablet_replica.cc:330] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: stopping tablet replica
I20260811 12:45:14.792403 23536 tablet_service.cc:1514] Processing DeleteTablet for tablet bf222133e12842b099082039d1314552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:14 UTC) from {username='kudu', principal='kudu/127.0.186.126@KRBTEST.COM'} at 127.0.0.1:34192
I20260811 12:45:14.792812 23806 raft_consensus.cc:2229] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:45:14.793646 23806 raft_consensus.cc:2258] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:14.796293 23806 ts_tablet_manager.cc:1905] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:14.798820 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 23316
I20260811 12:45:14.804613 23808 tablet_replica.cc:330] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: stopping tablet replica
I20260811 12:45:14.805251 23808 raft_consensus.cc:2229] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:14.805814 23806 ts_tablet_manager.cc:1918] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:14.805897 23808 raft_consensus.cc:2258] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:14.806020 23806 log.cc:1196] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/bf222133e12842b099082039d1314552
I20260811 12:45:14.806691 23806 ts_tablet_manager.cc:1939] T bf222133e12842b099082039d1314552 P 6555d71b501f41c3b7e074bd4ae101bc: Deleting consensus metadata
I20260811 12:45:14.808493 23808 ts_tablet_manager.cc:1905] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:14.808881 23231 catalog_manager.cc:4841] TS 6555d71b501f41c3b7e074bd4ae101bc (127.0.186.65:38439): tablet bf222133e12842b099082039d1314552 (table test-table [id=cb3fcfd8c7ca4501811a7f1d4f16bc36]) successfully deleted
I20260811 12:45:14.814324 23807 tablet_replica.cc:330] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: stopping tablet replica
I20260811 12:45:14.814496 23808 ts_tablet_manager.cc:1918] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:14.814742 23808 log.cc:1196] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/bf222133e12842b099082039d1314552
I20260811 12:45:14.814962 23807 raft_consensus.cc:2229] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:14.815443 23808 ts_tablet_manager.cc:1939] T bf222133e12842b099082039d1314552 P 2330312d8a4a40a3ba1fe946105b9986: Deleting consensus metadata
I20260811 12:45:14.815601 23807 raft_consensus.cc:2258] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:14.817863 23807 ts_tablet_manager.cc:1905] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:14.818257 23229 catalog_manager.cc:4841] TS 2330312d8a4a40a3ba1fe946105b9986 (127.0.186.66:38379): tablet bf222133e12842b099082039d1314552 (table test-table [id=cb3fcfd8c7ca4501811a7f1d4f16bc36]) successfully deleted
I20260811 12:45:14.823901 23807 ts_tablet_manager.cc:1918] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:14.824126 23807 log.cc:1196] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/bf222133e12842b099082039d1314552
I20260811 12:45:14.824599 23807 ts_tablet_manager.cc:1939] T bf222133e12842b099082039d1314552 P bdbe92a689f441569a916aebf5652b50: Deleting consensus metadata
I20260811 12:45:14.826416 23231 catalog_manager.cc:4841] TS bdbe92a689f441569a916aebf5652b50 (127.0.186.67:39935): tablet bf222133e12842b099082039d1314552 (table test-table [id=cb3fcfd8c7ca4501811a7f1d4f16bc36]) successfully deleted
Aug 11 12:45:14 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.65@KRBTEST.COM
I20260811 12:45:14.838826 23775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.800471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40364 (local address 127.0.186.65:38439)
0811 12:45:14.800662 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.800669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.813379 (+ 12710us) server_negotiation.cc:407] Connection header received
0811 12:45:14.813601 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.813607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.813750 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.813885 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:14.815963 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.817277 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.819820 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.820570 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.820712 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.831962 (+ 11250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:14.831988 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:14.832005 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:14.832059 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:14.835534 (+ 3475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.836354 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.836362 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.836364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.836537 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.837044 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.837055 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.837059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.837465 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:14.837800 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.838173 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.838447 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 12:45:14.839545 23453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:14.944912 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 23316
I20260811 12:45:14.971119 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 23467
Aug 11 12:45:14 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.66@KRBTEST.COM
I20260811 12:45:14.988682 23777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:14.971993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34200 (local address 127.0.186.66:38379)
0811 12:45:14.972293 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:14.972300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:14.972426 (+ 126us) server_negotiation.cc:407] Connection header received
0811 12:45:14.972675 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:14.972688 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:14.972839 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:14.972979 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:14.974484 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.975294 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.976722 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:14.977229 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:14.977388 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:14.982408 (+ 5020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:14.982428 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:14.982452 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:14.982495 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:14.985640 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.986413 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.986421 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.986423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.986563 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:14.986973 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:14.986979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:14.986982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:14.987397 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:14.987716 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:14.988064 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 12:45:14.988310 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260811 12:45:14.989542 23605 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:15.084779 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 23467
I20260811 12:45:15.112265 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 23616
Aug 11 12:45:15 dist-test-slave-qg60 krb5kdc[23196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.67@KRBTEST.COM
I20260811 12:45:15.129958 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:15.113236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43242 (local address 127.0.186.67:39935)
0811 12:45:15.113417 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:15.113421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:15.113443 (+ 22us) server_negotiation.cc:407] Connection header received
0811 12:45:15.113506 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:15.113510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:15.113598 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:15.113692 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:15.115237 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:15.116044 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:15.117704 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:15.118206 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:15.118318 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:15.123619 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:15.123638 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:15.123655 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:15.123696 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:15.126939 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:15.127776 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:15.127783 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:15.127786 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:15.127919 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:15.128308 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:15.128311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:15.128313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:15.128671 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:15.129043 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:15.129376 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 12:45:15.129560 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 12:45:15.130716 23754 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:15.223490 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 23616
I20260811 12:45:15.246631 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 23211
I20260811 12:45:15.247969 23282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:15.385483 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 23211
2026-08-11T12:45:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5219 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T12:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:15Z Disabled control of system clock
I20260811 12:45:15.497267 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:41345
--webserver_interface=127.0.186.126
--webserver_port=0
--builtin_ntp_servers=127.0.186.84:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:41345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 12:45:15.863924 23817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:15.864349 23817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:15.864514 23817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:15.872067 23817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:15.872191 23817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:15.872282 23817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:15.872385 23817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:15.872458 23817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:15.882185 23817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:41345
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:41345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:15.883576 23817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:15.885653 23817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:15.898355 23823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:15.898442 23825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:15.898442 23822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:15.899446 23817 server_base.cc:1034] running on GCE node
I20260811 12:45:15.900331 23817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:15.901969 23817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:15.903220 23817 hybrid_clock.cc:648] HybridClock initialized: now 1786452315903154 us; error 65 us; skew 500 ppm
I20260811 12:45:15.903601 23817 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:15.906068 23817 webserver.cc:460] Webserver started at http://127.0.186.126:45209/ using document root <none> and password file <none>
I20260811 12:45:15.906812 23817 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:15.906948 23817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:15.907294 23817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:15.910486 23817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "fe0865d93a714a7c94162307e9f7bdb9"
format_stamp: "Formatted at 2026-08-11 12:45:15 on dist-test-slave-qg60"
server_key: "47515cdd02905d450874e639cfbf5c34"
server_key_iv: "6e11720f0088a5c56a7bd53b7a4e5383"
server_key_version: "encryptionkey@0"
I20260811 12:45:15.911348 23817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "fe0865d93a714a7c94162307e9f7bdb9"
format_stamp: "Formatted at 2026-08-11 12:45:15 on dist-test-slave-qg60"
server_key: "47515cdd02905d450874e639cfbf5c34"
server_key_iv: "6e11720f0088a5c56a7bd53b7a4e5383"
server_key_version: "encryptionkey@0"
I20260811 12:45:15.916922 23817 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 12:45:15.920574 23833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:15.922071 23817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:15.922283 23817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "fe0865d93a714a7c94162307e9f7bdb9"
format_stamp: "Formatted at 2026-08-11 12:45:15 on dist-test-slave-qg60"
server_key: "47515cdd02905d450874e639cfbf5c34"
server_key_iv: "6e11720f0088a5c56a7bd53b7a4e5383"
server_key_version: "encryptionkey@0"
I20260811 12:45:15.922530 23817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:15.944926 23817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:15.945879 23817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:15.946229 23817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:15.967022 23817 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:41345
I20260811 12:45:15.967057 23892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:41345 every 8 connection(s)
I20260811 12:45:15.968698 23817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:15.973305 23893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:15.976553 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 23817
I20260811 12:45:15.976794 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:15.977304 745 external_mini_cluster.cc:1428] Setting key 6d7b76f728ba776f225ecc13e595761e
I20260811 12:45:15.987187 23893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9: Bootstrap starting.
I20260811 12:45:15.991482 23893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:15.992893 23893 log.cc:824] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:15.993333 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:15.979546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46916 (local address 127.0.186.126:41345)
0811 12:45:15.980661 (+ 1115us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:15.980673 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:15.980720 (+ 47us) server_negotiation.cc:407] Connection header received
0811 12:45:15.982623 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:15.982650 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:15.983202 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:15.983570 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:15.984337 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:15.985799 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:15.987896 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:15.988669 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:15.988930 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:15.990394 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:15.990402 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:15.990418 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:15.991032 (+ 614us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:15.991141 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:15.991166 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:15.991256 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:15.991616 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 12:45:15.992028 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":422,"threads_started":1}
I20260811 12:45:15.996265 23893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9: No bootstrap required, opened a new log
I20260811 12:45:16.004766 23893 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe0865d93a714a7c94162307e9f7bdb9" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41345 } }
I20260811 12:45:16.005275 23893 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:16.005394 23893 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe0865d93a714a7c94162307e9f7bdb9, State: Initialized, Role: FOLLOWER
I20260811 12:45:16.006078 23893 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe0865d93a714a7c94162307e9f7bdb9" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41345 } }
I20260811 12:45:16.006359 23893 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:16.006520 23893 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:16.006712 23893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:16.009696 23893 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe0865d93a714a7c94162307e9f7bdb9" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41345 } }
I20260811 12:45:16.010344 23893 leader_election.cc:302] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe0865d93a714a7c94162307e9f7bdb9; no voters:
I20260811 12:45:16.010985 23893 leader_election.cc:288] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:16.011183 23900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:16.012072 23900 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [term 1 LEADER]: Becoming Leader. State: Replica: fe0865d93a714a7c94162307e9f7bdb9, State: Running, Role: LEADER
I20260811 12:45:16.012667 23900 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe0865d93a714a7c94162307e9f7bdb9" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41345 } }
I20260811 12:45:16.013523 23893 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:16.015964 23902 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe0865d93a714a7c94162307e9f7bdb9. Latest consensus state: current_term: 1 leader_uuid: "fe0865d93a714a7c94162307e9f7bdb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe0865d93a714a7c94162307e9f7bdb9" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41345 } } }
I20260811 12:45:16.016512 23902 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:16.016999 23901 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe0865d93a714a7c94162307e9f7bdb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe0865d93a714a7c94162307e9f7bdb9" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 41345 } } }
I20260811 12:45:16.017485 23901 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:16.019407 23905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:16.026598 23905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:16.038035 23905 catalog_manager.cc:1347] Generated new cluster ID: 8f9402fcecc5484fa1d568416c1cf754
I20260811 12:45:16.038193 23905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:16.052322 23905 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:16.054405 23905 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:16.065101 23905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9: Generated new TSK 0
I20260811 12:45:16.066406 23905 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:16.083374 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.65:0
--local_ip_for_outbound_sockets=127.0.186.65
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41345
--builtin_ntp_servers=127.0.186.84:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 12:45:16.474835 23920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:16.475186 23920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:16.475337 23920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:16.483328 23920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:16.483465 23920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:16.483652 23920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.65
I20260811 12:45:16.493947 23920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.186.65
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.65
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:16.495445 23920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:16.497705 23920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:16.512691 23925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:16.512632 23928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:16.512580 23926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:16.513737 23920 server_base.cc:1034] running on GCE node
I20260811 12:45:16.514647 23920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:16.515741 23920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:16.517052 23920 hybrid_clock.cc:648] HybridClock initialized: now 1786452316516975 us; error 62 us; skew 500 ppm
I20260811 12:45:16.517414 23920 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:16.520090 23920 webserver.cc:460] Webserver started at http://127.0.186.65:36577/ using document root <none> and password file <none>
I20260811 12:45:16.520934 23920 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:16.521070 23920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:16.521435 23920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:16.524819 23920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data/instance:
uuid: "545e2e8e65914612adb76db82c32c53e"
format_stamp: "Formatted at 2026-08-11 12:45:16 on dist-test-slave-qg60"
server_key: "a096217c6cb204011b325179bc95fc49"
server_key_iv: "deb565e5f28f78c346a92f783a3be8b6"
server_key_version: "encryptionkey@0"
I20260811 12:45:16.525774 23920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal/instance:
uuid: "545e2e8e65914612adb76db82c32c53e"
format_stamp: "Formatted at 2026-08-11 12:45:16 on dist-test-slave-qg60"
server_key: "a096217c6cb204011b325179bc95fc49"
server_key_iv: "deb565e5f28f78c346a92f783a3be8b6"
server_key_version: "encryptionkey@0"
I20260811 12:45:16.531888 23920 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 12:45:16.536083 23934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:16.537696 23920 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:16.537889 23920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal
uuid: "545e2e8e65914612adb76db82c32c53e"
format_stamp: "Formatted at 2026-08-11 12:45:16 on dist-test-slave-qg60"
server_key: "a096217c6cb204011b325179bc95fc49"
server_key_iv: "deb565e5f28f78c346a92f783a3be8b6"
server_key_version: "encryptionkey@0"
I20260811 12:45:16.538151 23920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:16.575443 23920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:16.576442 23920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:16.576864 23920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:16.578014 23920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:16.579799 23920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:16.579947 23920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:16.580108 23920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:16.580214 23920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:16.616923 23920 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.65:35239
I20260811 12:45:16.617022 24059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.65:35239 every 8 connection(s)
I20260811 12:45:16.618395 23920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/data/info.pb
I20260811 12:45:16.620280 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 23920
I20260811 12:45:16.620494 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal/instance
I20260811 12:45:16.621042 745 external_mini_cluster.cc:1428] Setting key 8abc0b5646982e2b31187b5396bfd663
I20260811 12:45:16.624715 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.66:0
--local_ip_for_outbound_sockets=127.0.186.66
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41345
--builtin_ntp_servers=127.0.186.84:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 12:45:16.635474 24062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:16.621727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.65:43483 (local address 127.0.186.126:41345)
0811 12:45:16.622279 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:16.622286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:16.623813 (+ 1527us) server_negotiation.cc:407] Connection header received
0811 12:45:16.626842 (+ 3029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:16.626846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:16.626916 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:16.627019 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:16.628550 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:16.629428 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:16.631963 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:16.632403 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:16.632506 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:16.634432 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:16.634440 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:16.634447 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:16.634473 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:16.634526 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:16.634543 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:16.634638 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:16.634925 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 12:45:16.635038 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":279,"threads_started":1}
I20260811 12:45:16.636976 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:16.622280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41345 (local address 127.0.186.65:43483)
0811 12:45:16.623628 (+ 1348us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:16.623688 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:16.626517 (+ 2829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:16.627317 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:16.627330 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:16.627468 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:16.628344 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:16.628371 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:16.629608 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:16.629615 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:16.631788 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:16.631815 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:16.632667 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:16.632677 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:16.633081 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:16.634001 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:16.634007 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:16.634070 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:16.634195 (+ 125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:16.634665 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:16.634680 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:16.634692 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 12:45:16.634914 (+ 222us) client_negotiation.cc:240] Negotiation successful
0811 12:45:16.635396 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":370,"threads_started":1}
I20260811 12:45:16.638638 24060 heartbeater.cc:347] Connected to a master server at 127.0.186.126:41345
I20260811 12:45:16.639004 24060 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:16.640005 24060 heartbeater.cc:511] Master 127.0.186.126:41345 requested a full tablet report, sending...
I20260811 12:45:16.642503 23853 ts_manager.cc:194] Registered new tserver with Master: 545e2e8e65914612adb76db82c32c53e (127.0.186.65:35239)
I20260811 12:45:16.644836 23853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.65:43483
W20260811 12:45:17.007493 24065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:17.007835 24065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:17.007989 24065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:17.016191 24065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:17.016316 24065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:17.016496 24065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.66
I20260811 12:45:17.026757 24065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.186.66
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.66
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:17.028234 24065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:17.030251 24065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:17.044776 24071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:17.044823 24070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:17.044800 24073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:17.045857 24065 server_base.cc:1034] running on GCE node
I20260811 12:45:17.046581 24065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:17.047618 24065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:17.048897 24065 hybrid_clock.cc:648] HybridClock initialized: now 1786452317048794 us; error 82 us; skew 500 ppm
I20260811 12:45:17.049242 24065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:17.051692 24065 webserver.cc:460] Webserver started at http://127.0.186.66:34929/ using document root <none> and password file <none>
I20260811 12:45:17.052449 24065 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:17.052596 24065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:17.053030 24065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:17.056154 24065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data/instance:
uuid: "641f8c59b1d2411792fc20bb30983ae0"
format_stamp: "Formatted at 2026-08-11 12:45:17 on dist-test-slave-qg60"
server_key: "c8538e0e014654f6033774830cb78f2b"
server_key_iv: "3753a53a2cbcd2fa499e4c73e39726bc"
server_key_version: "encryptionkey@0"
I20260811 12:45:17.057088 24065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal/instance:
uuid: "641f8c59b1d2411792fc20bb30983ae0"
format_stamp: "Formatted at 2026-08-11 12:45:17 on dist-test-slave-qg60"
server_key: "c8538e0e014654f6033774830cb78f2b"
server_key_iv: "3753a53a2cbcd2fa499e4c73e39726bc"
server_key_version: "encryptionkey@0"
I20260811 12:45:17.062798 24065 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 12:45:17.066645 24079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:17.068069 24065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:45:17.068264 24065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal
uuid: "641f8c59b1d2411792fc20bb30983ae0"
format_stamp: "Formatted at 2026-08-11 12:45:17 on dist-test-slave-qg60"
server_key: "c8538e0e014654f6033774830cb78f2b"
server_key_iv: "3753a53a2cbcd2fa499e4c73e39726bc"
server_key_version: "encryptionkey@0"
I20260811 12:45:17.068518 24065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:17.084499 24065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:17.085552 24065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:17.085917 24065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:17.087038 24065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:17.088747 24065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:17.088881 24065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:17.089040 24065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:17.089138 24065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:17.135589 24065 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.66:43263
I20260811 12:45:17.135665 24204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.66:43263 every 8 connection(s)
I20260811 12:45:17.137324 24065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/data/info.pb
I20260811 12:45:17.146483 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24065
I20260811 12:45:17.146733 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal/instance
I20260811 12:45:17.147189 745 external_mini_cluster.cc:1428] Setting key e279a4242b6c7edc291d5ea9269da501
I20260811 12:45:17.150683 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.186.67:0
--local_ip_for_outbound_sockets=127.0.186.67
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41345
--builtin_ntp_servers=127.0.186.84:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 12:45:17.151928 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.140278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.66:43763 (local address 127.0.186.126:41345)
0811 12:45:17.140915 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.140923 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.142289 (+ 1366us) server_negotiation.cc:407] Connection header received
0811 12:45:17.144293 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.144297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.144375 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.144485 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:17.145740 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.146490 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.148470 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.149070 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.149229 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.151081 (+ 1852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:17.151086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:17.151090 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:17.151110 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:17.151160 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:17.151174 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:17.151251 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.151533 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.151621 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":296,"threads_started":1}
I20260811 12:45:17.153645 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.140943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41345 (local address 127.0.186.66:43763)
0811 12:45:17.142102 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.142149 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.143991 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.144817 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.144827 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.144927 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:17.145544 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.145562 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.146683 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.146688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.148305 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.148319 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.149306 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.149311 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.149697 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.150592 (+ 895us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:17.150599 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:17.150668 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:17.150794 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:17.151285 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:17.151300 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:17.151311 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.151519 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.152012 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":383,"threads_started":1}
I20260811 12:45:17.155339 24205 heartbeater.cc:347] Connected to a master server at 127.0.186.126:41345
I20260811 12:45:17.155678 24205 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:17.156486 24205 heartbeater.cc:511] Master 127.0.186.126:41345 requested a full tablet report, sending...
I20260811 12:45:17.158164 23853 ts_manager.cc:194] Registered new tserver with Master: 641f8c59b1d2411792fc20bb30983ae0 (127.0.186.66:43263)
I20260811 12:45:17.159394 23853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.66:43763
W20260811 12:45:17.522117 24210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:17.522490 24210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:17.522667 24210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:17.530277 24210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:17.530439 24210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:17.530620 24210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.186.67
I20260811 12:45:17.539994 24210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.186.67
--webserver_port=0
--tserver_master_addrs=127.0.186.126:41345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.186.67
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:17.541447 24210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:17.543480 24210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:17.557868 24215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:17.557757 24218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:17.557871 24216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:17.559211 24210 server_base.cc:1034] running on GCE node
I20260811 12:45:17.560065 24210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:17.561389 24210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:17.562670 24210 hybrid_clock.cc:648] HybridClock initialized: now 1786452317562625 us; error 57 us; skew 500 ppm
I20260811 12:45:17.563067 24210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:45:17.566232 24210 webserver.cc:460] Webserver started at http://127.0.186.67:41243/ using document root <none> and password file <none>
I20260811 12:45:17.567060 24210 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:17.567235 24210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:17.567602 24210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:17.570963 24210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data/instance:
uuid: "6694feac46884ecf97bd658cfed42a9e"
format_stamp: "Formatted at 2026-08-11 12:45:17 on dist-test-slave-qg60"
server_key: "1b16f188c821f68ada49bdb342fc9863"
server_key_iv: "a5f1edb710587cf52c33793b17cedf7a"
server_key_version: "encryptionkey@0"
I20260811 12:45:17.571952 24210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal/instance:
uuid: "6694feac46884ecf97bd658cfed42a9e"
format_stamp: "Formatted at 2026-08-11 12:45:17 on dist-test-slave-qg60"
server_key: "1b16f188c821f68ada49bdb342fc9863"
server_key_iv: "a5f1edb710587cf52c33793b17cedf7a"
server_key_version: "encryptionkey@0"
I20260811 12:45:17.578686 24210 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 12:45:17.582720 24224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:17.584246 24210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:45:17.584458 24210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal
uuid: "6694feac46884ecf97bd658cfed42a9e"
format_stamp: "Formatted at 2026-08-11 12:45:17 on dist-test-slave-qg60"
server_key: "1b16f188c821f68ada49bdb342fc9863"
server_key_iv: "a5f1edb710587cf52c33793b17cedf7a"
server_key_version: "encryptionkey@0"
I20260811 12:45:17.584722 24210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:17.605345 24210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:17.606344 24210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:17.606709 24210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:17.607884 24210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:45:17.609763 24210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:45:17.609912 24210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:17.610050 24210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:45:17.610155 24210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:17.648341 24060 heartbeater.cc:503] Master 127.0.186.126:41345 was elected leader, sending a full tablet report...
I20260811 12:45:17.651753 24210 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.67:40491
I20260811 12:45:17.651855 24349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.67:40491 every 8 connection(s)
I20260811 12:45:17.653550 24210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/data/info.pb
I20260811 12:45:17.660852 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24210
I20260811 12:45:17.661087 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal/instance
I20260811 12:45:17.661726 745 external_mini_cluster.cc:1428] Setting key 313cdba2e20bdca0f063979968d6b249
I20260811 12:45:17.669083 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.656834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:42271 (local address 127.0.186.126:41345)
0811 12:45:17.657383 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.657388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.658794 (+ 1406us) server_negotiation.cc:407] Connection header received
0811 12:45:17.661324 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.661329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.661409 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.661517 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:17.663244 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.664192 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.666054 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.666481 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.666627 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.668088 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:17.668093 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:17.668096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:17.668115 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:17.668161 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:17.668174 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:17.668278 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.668517 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.668625 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":304,"threads_started":1}
I20260811 12:45:17.670141 24354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.657563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:41345 (local address 127.0.186.67:42271)
0811 12:45:17.658611 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.658652 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.660940 (+ 2288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.661869 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.661882 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.662040 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:45:17.662981 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.663005 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.664363 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.664369 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.665890 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.665905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.666744 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.666752 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.666999 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.667734 (+ 735us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 12:45:17.667737 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:45:17.667782 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 12:45:17.667871 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:45:17.668279 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:45:17.668295 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:45:17.668306 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.668508 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.668984 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":322,"threads_started":1}
I20260811 12:45:17.671862 24351 heartbeater.cc:347] Connected to a master server at 127.0.186.126:41345
I20260811 12:45:17.672205 24351 heartbeater.cc:464] Registering TS with master...
I20260811 12:45:17.673207 24351 heartbeater.cc:511] Master 127.0.186.126:41345 requested a full tablet report, sending...
I20260811 12:45:17.674886 23853 ts_manager.cc:194] Registered new tserver with Master: 6694feac46884ecf97bd658cfed42a9e (127.0.186.67:40491)
I20260811 12:45:17.675900 23853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.186.67:42271
I20260811 12:45:17.678376 745 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:45:17.689510 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.683257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46932 (local address 127.0.186.126:41345)
0811 12:45:17.683453 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.683457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.683901 (+ 444us) server_negotiation.cc:407] Connection header received
0811 12:45:17.684039 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.684043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.684155 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.684255 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:17.684713 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.685611 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.686961 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.687423 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.687529 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.688543 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:17.688548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:17.688553 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:17.688578 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:17.688614 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:17.688654 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:17.688814 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.688951 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.689037 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:45:17.693856 23852 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 12:45:17.702132 23852 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:45:17.740978 24366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.715647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:43263 (local address 127.0.0.1:38860)
0811 12:45:17.729529 (+ 13882us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.729577 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.729966 (+ 389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.731283 (+ 1317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.731295 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.731341 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:17.731920 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.731938 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.734746 (+ 2808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.734755 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.737616 (+ 2861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.737628 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.739736 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.739743 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.739984 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.740066 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.740225 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.740462 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13557,"mutex_wait_us":66,"thread_start_us":13331,"threads_started":1}
I20260811 12:45:17.741530 24368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.715985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38860 (local address 127.0.186.66:43263)
0811 12:45:17.728367 (+ 12382us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.728382 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.729752 (+ 1370us) server_negotiation.cc:407] Connection header received
0811 12:45:17.730310 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.730319 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.730604 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.730839 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:17.732232 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.734477 (+ 2245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.737869 (+ 3392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.739124 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.739284 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.739588 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.740896 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.741124 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12070,"thread_start_us":12409,"threads_started":1}
I20260811 12:45:17.742049 24369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.716373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51000 (local address 127.0.186.65:35239)
0811 12:45:17.731113 (+ 14740us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.731121 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.731147 (+ 26us) server_negotiation.cc:407] Connection header received
0811 12:45:17.731226 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.731231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.731404 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.731627 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:17.732605 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.735047 (+ 2442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.738253 (+ 3206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.739773 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.739941 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.740281 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.741487 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.741675 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14569,"thread_start_us":14295,"threads_started":1}
I20260811 12:45:17.744544 24367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.715961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51000)
0811 12:45:17.730131 (+ 14170us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.730161 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.730352 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.731623 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.731628 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.731661 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:17.732281 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.732303 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.735285 (+ 2982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.735290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.738021 (+ 2731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.738037 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.740434 (+ 2397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.740441 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.740680 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.740715 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.740833 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.741002 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13961,"mutex_wait_us":26,"thread_start_us":13200,"threads_started":1}
I20260811 12:45:17.747664 24132 tablet_service.cc:1467] Processing CreateTablet for tablet 7a1a025a2b8741b6ae77ce06a19023f0 (DEFAULT_TABLE table=test-table [id=b799000a0ea54e149f049488092bc0d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:17.748548 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.732080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.67:40491 (local address 127.0.0.1:50868)
0811 12:45:17.736121 (+ 4041us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.736148 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.736380 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.737338 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.737343 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.737374 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:17.737900 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.737910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.739975 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.739981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.744385 (+ 4404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.744405 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.747565 (+ 3160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.747574 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.747814 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.747861 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.747971 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.748162 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3852,"thread_start_us":3662,"threads_started":1}
I20260811 12:45:17.749490 24371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.730405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.0.186.67:40491)
0811 12:45:17.735509 (+ 5104us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.735522 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.736253 (+ 731us) server_negotiation.cc:407] Connection header received
0811 12:45:17.736624 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.736637 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.736943 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.737142 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:17.738077 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.739778 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.744970 (+ 5192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.746842 (+ 1872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.746979 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.747322 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.748838 (+ 1516us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.749073 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4878,"thread_start_us":4700,"threads_started":1}
I20260811 12:45:17.749665 24132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a1a025a2b8741b6ae77ce06a19023f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:17.757553 24278 tablet_service.cc:1467] Processing CreateTablet for tablet 7a1a025a2b8741b6ae77ce06a19023f0 (DEFAULT_TABLE table=test-table [id=b799000a0ea54e149f049488092bc0d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:17.759541 24278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a1a025a2b8741b6ae77ce06a19023f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:17.760629 23988 tablet_service.cc:1467] Processing CreateTablet for tablet 7a1a025a2b8741b6ae77ce06a19023f0 (DEFAULT_TABLE table=test-table [id=b799000a0ea54e149f049488092bc0d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 12:45:17.762346 23988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a1a025a2b8741b6ae77ce06a19023f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:17.768046 24373 tablet_bootstrap.cc:492] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Bootstrap starting.
I20260811 12:45:17.772234 24373 tablet_bootstrap.cc:654] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:17.773833 24373 log.cc:824] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:17.778654 24376 tablet_bootstrap.cc:492] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Bootstrap starting.
I20260811 12:45:17.780125 24373 tablet_bootstrap.cc:492] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: No bootstrap required, opened a new log
I20260811 12:45:17.780460 24373 ts_tablet_manager.cc:1397] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.008s
I20260811 12:45:17.783150 24376 tablet_bootstrap.cc:654] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:17.783710 24377 tablet_bootstrap.cc:492] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Bootstrap starting.
I20260811 12:45:17.784665 24376 log.cc:824] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:17.787945 24377 tablet_bootstrap.cc:654] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:17.789742 24377 log.cc:824] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:17.792616 24373 raft_consensus.cc:348] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.793323 24373 raft_consensus.cc:374] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:17.793442 24373 raft_consensus.cc:729] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f8c59b1d2411792fc20bb30983ae0, State: Initialized, Role: FOLLOWER
I20260811 12:45:17.793603 24376 tablet_bootstrap.cc:492] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: No bootstrap required, opened a new log
I20260811 12:45:17.793963 24376 ts_tablet_manager.cc:1397] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260811 12:45:17.794231 24373 consensus_queue.cc:260] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.796228 24377 tablet_bootstrap.cc:492] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: No bootstrap required, opened a new log
I20260811 12:45:17.796598 24377 ts_tablet_manager.cc:1397] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260811 12:45:17.801636 24205 heartbeater.cc:503] Master 127.0.186.126:41345 was elected leader, sending a full tablet report...
I20260811 12:45:17.802752 24373 ts_tablet_manager.cc:1428] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Time spent starting tablet: real 0.022s user 0.013s sys 0.009s
I20260811 12:45:17.803650 24376 raft_consensus.cc:348] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.804158 24376 raft_consensus.cc:374] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:17.804301 24376 raft_consensus.cc:729] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6694feac46884ecf97bd658cfed42a9e, State: Initialized, Role: FOLLOWER
I20260811 12:45:17.805028 24376 consensus_queue.cc:260] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.807227 24351 heartbeater.cc:503] Master 127.0.186.126:41345 was elected leader, sending a full tablet report...
I20260811 12:45:17.808115 24376 ts_tablet_manager.cc:1428] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260811 12:45:17.808338 24377 raft_consensus.cc:348] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.808923 24377 raft_consensus.cc:374] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:17.809055 24377 raft_consensus.cc:729] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 545e2e8e65914612adb76db82c32c53e, State: Initialized, Role: FOLLOWER
I20260811 12:45:17.809912 24377 consensus_queue.cc:260] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.811887 24377 ts_tablet_manager.cc:1428] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Time spent starting tablet: real 0.015s user 0.013s sys 0.004s
I20260811 12:45:17.833442 24381 raft_consensus.cc:482] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:45:17.833829 24381 raft_consensus.cc:504] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.835654 24381 leader_election.cc:288] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 641f8c59b1d2411792fc20bb30983ae0 (127.0.186.66:43263), 545e2e8e65914612adb76db82c32c53e (127.0.186.65:35239)
I20260811 12:45:17.844718 24369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.836174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:56941 (local address 127.0.186.65:35239)
0811 12:45:17.836388 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.836394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.836520 (+ 126us) server_negotiation.cc:407] Connection header received
0811 12:45:17.836862 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.836868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.836970 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.837095 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:17.837805 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.839067 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.841950 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.843390 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.843593 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.843672 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.844271 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.844427 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 12:45:17.844775 24368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.836255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.186.67:39861 (local address 127.0.186.66:43263)
0811 12:45:17.836456 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.836464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.837110 (+ 646us) server_negotiation.cc:407] Connection header received
0811 12:45:17.837302 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.837308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.837418 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.837559 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 12:45:17.838204 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.839325 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.841950 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.843427 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.843590 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.843674 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.844271 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.844436 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:45:17.844815 24354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.836011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.186.67:56941)
0811 12:45:17.836391 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.836417 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.836622 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.837250 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.837257 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.837290 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:17.837559 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.837572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.839251 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.839255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.841729 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.841744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.843626 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.843632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.843944 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.844081 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.844195 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.844391 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":213}
I20260811 12:45:17.844871 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.836125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.66:43263 (local address 127.0.186.67:39861)
0811 12:45:17.836981 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:17.837000 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 12:45:17.837142 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:45:17.837595 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:45:17.837599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:45:17.837631 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 12:45:17.838014 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.838025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.839475 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.839481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.841727 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:45:17.841744 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.843631 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.843636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:45:17.843942 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.844081 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 12:45:17.844191 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 12:45:17.844391 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":165,"thread_start_us":493,"threads_started":1}
I20260811 12:45:17.846506 24153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a1a025a2b8741b6ae77ce06a19023f0" candidate_uuid: "6694feac46884ecf97bd658cfed42a9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f8c59b1d2411792fc20bb30983ae0" is_pre_election: true
I20260811 12:45:17.846506 24008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a1a025a2b8741b6ae77ce06a19023f0" candidate_uuid: "6694feac46884ecf97bd658cfed42a9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "545e2e8e65914612adb76db82c32c53e" is_pre_election: true
I20260811 12:45:17.847227 24153 raft_consensus.cc:2454] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6694feac46884ecf97bd658cfed42a9e in term 0.
I20260811 12:45:17.847235 24008 raft_consensus.cc:2454] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6694feac46884ecf97bd658cfed42a9e in term 0.
I20260811 12:45:17.848196 24225 leader_election.cc:302] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f8c59b1d2411792fc20bb30983ae0, 6694feac46884ecf97bd658cfed42a9e; no voters:
I20260811 12:45:17.848795 24381 raft_consensus.cc:2781] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:45:17.848984 24381 raft_consensus.cc:482] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:45:17.849143 24381 raft_consensus.cc:3037] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:17.851480 24381 raft_consensus.cc:504] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.852164 24381 leader_election.cc:288] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [CANDIDATE]: Term 1 election: Requested vote from peers 641f8c59b1d2411792fc20bb30983ae0 (127.0.186.66:43263), 545e2e8e65914612adb76db82c32c53e (127.0.186.65:35239)
I20260811 12:45:17.852825 24153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a1a025a2b8741b6ae77ce06a19023f0" candidate_uuid: "6694feac46884ecf97bd658cfed42a9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f8c59b1d2411792fc20bb30983ae0"
I20260811 12:45:17.852842 24008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a1a025a2b8741b6ae77ce06a19023f0" candidate_uuid: "6694feac46884ecf97bd658cfed42a9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "545e2e8e65914612adb76db82c32c53e"
I20260811 12:45:17.853084 24008 raft_consensus.cc:3037] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:17.853070 24153 raft_consensus.cc:3037] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:17.855453 24008 raft_consensus.cc:2454] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6694feac46884ecf97bd658cfed42a9e in term 1.
I20260811 12:45:17.855747 24153 raft_consensus.cc:2454] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6694feac46884ecf97bd658cfed42a9e in term 1.
I20260811 12:45:17.856040 24226 leader_election.cc:302] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 545e2e8e65914612adb76db82c32c53e, 6694feac46884ecf97bd658cfed42a9e; no voters:
I20260811 12:45:17.856478 24381 raft_consensus.cc:2781] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:17.857034 24381 raft_consensus.cc:686] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 1 LEADER]: Becoming Leader. State: Replica: 6694feac46884ecf97bd658cfed42a9e, State: Running, Role: LEADER
I20260811 12:45:17.857663 24381 consensus_queue.cc:237] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } }
I20260811 12:45:17.862828 23851 catalog_manager.cc:5495] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6694feac46884ecf97bd658cfed42a9e (127.0.186.67). New cstate: current_term: 1 leader_uuid: "6694feac46884ecf97bd658cfed42a9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6694feac46884ecf97bd658cfed42a9e" member_type: VOTER last_known_addr { host: "127.0.186.67" port: 40491 } health_report { overall_health: HEALTHY } } }
W20260811 12:45:17.871347 24061 tablet.cc:2369] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:45:17.889767 24206 tablet.cc:2369] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:45:17.896306 24371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.890430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.0.186.67:40491)
0811 12:45:17.890704 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.890712 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.890953 (+ 241us) server_negotiation.cc:407] Connection header received
0811 12:45:17.891150 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.891154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.891236 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.891363 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:45:17.891758 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.892469 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.894102 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.894514 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.894620 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.895147 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:45:17.895681 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:45:17.895800 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.895936 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.896004 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 12:45:17.904908 24153 raft_consensus.cc:1261] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 1 FOLLOWER]: Refusing update from remote peer 6694feac46884ecf97bd658cfed42a9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:45:17.904904 24008 raft_consensus.cc:1261] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 1 FOLLOWER]: Refusing update from remote peer 6694feac46884ecf97bd658cfed42a9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 12:45:17.905720 24352 tablet.cc:2369] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:45:17.906002 24384 consensus_queue.cc:1035] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f8c59b1d2411792fc20bb30983ae0" member_type: VOTER last_known_addr { host: "127.0.186.66" port: 43263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:17.906438 24381 consensus_queue.cc:1035] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "545e2e8e65914612adb76db82c32c53e" member_type: VOTER last_known_addr { host: "127.0.186.65" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:45:17.919097 24387 mvcc.cc:205] Tried to move back new op lower bound from 7317308694127669248 to 7317308693949874176. Current Snapshot: MvccSnapshot[applied={T|T < 7317308694127669248}]
I20260811 12:45:17.936813 23851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:17.937112 23851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 12:45:17.941188 23851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe0865d93a714a7c94162307e9f7bdb9: Sending DeleteTablet for 3 replicas of tablet 7a1a025a2b8741b6ae77ce06a19023f0
I20260811 12:45:17.942652 24132 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a1a025a2b8741b6ae77ce06a19023f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:17 UTC) from {username='slave'} at 127.0.0.1:38860
I20260811 12:45:17.942633 23988 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a1a025a2b8741b6ae77ce06a19023f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:17 UTC) from {username='slave'} at 127.0.0.1:51000
I20260811 12:45:17.943600 24278 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a1a025a2b8741b6ae77ce06a19023f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 12:45:17 UTC) from {username='slave'} at 127.0.0.1:50868
I20260811 12:45:17.943764 24398 tablet_replica.cc:330] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: stopping tablet replica
I20260811 12:45:17.944263 24398 raft_consensus.cc:2229] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:17.945011 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 23920
I20260811 12:45:17.945240 24397 tablet_replica.cc:330] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: stopping tablet replica
I20260811 12:45:17.945710 24397 raft_consensus.cc:2229] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 12:45:17.946244 24397 raft_consensus.cc:2258] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:17.946746 24398 raft_consensus.cc:2258] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:17.949921 24398 ts_tablet_manager.cc:1905] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:17.954043 24397 ts_tablet_manager.cc:1905] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:17.955062 24399 tablet_replica.cc:330] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: stopping tablet replica
I20260811 12:45:17.955714 24399 raft_consensus.cc:2229] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 1 LEADER]: Raft consensus shutting down.
I20260811 12:45:17.956617 24399 raft_consensus.cc:2258] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 12:45:17.959197 24399 ts_tablet_manager.cc:1905] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 12:45:17.965320 24397 ts_tablet_manager.cc:1918] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:17.965559 24397 log.cc:1196] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-1/wal/wals/7a1a025a2b8741b6ae77ce06a19023f0
I20260811 12:45:17.966262 24397 ts_tablet_manager.cc:1939] T 7a1a025a2b8741b6ae77ce06a19023f0 P 641f8c59b1d2411792fc20bb30983ae0: Deleting consensus metadata
I20260811 12:45:17.967381 24399 ts_tablet_manager.cc:1918] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:17.967585 24399 log.cc:1196] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-2/wal/wals/7a1a025a2b8741b6ae77ce06a19023f0
I20260811 12:45:17.968211 24399 ts_tablet_manager.cc:1939] T 7a1a025a2b8741b6ae77ce06a19023f0 P 6694feac46884ecf97bd658cfed42a9e: Deleting consensus metadata
I20260811 12:45:17.968411 23834 catalog_manager.cc:4841] TS 641f8c59b1d2411792fc20bb30983ae0 (127.0.186.66:43263): tablet 7a1a025a2b8741b6ae77ce06a19023f0 (table test-table [id=b799000a0ea54e149f049488092bc0d9]) successfully deleted
I20260811 12:45:17.969594 24369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:17.948952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51002 (local address 127.0.186.65:35239)
0811 12:45:17.949193 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:17.949202 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:17.958655 (+ 9453us) server_negotiation.cc:407] Connection header received
0811 12:45:17.959278 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:17.959284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:17.959392 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:17.959482 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:17.960296 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.961626 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.963690 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:17.964356 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:17.964493 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:17.966296 (+ 1803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:17.966310 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:17.966328 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:17.967259 (+ 931us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:17.967326 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:17.967357 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:17.967470 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:17.969011 (+ 1541us) server_negotiation.cc:299] Negotiation successful
0811 12:45:17.969184 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 12:45:17.970292 23834 catalog_manager.cc:4841] TS 6694feac46884ecf97bd658cfed42a9e (127.0.186.67:40491): tablet 7a1a025a2b8741b6ae77ce06a19023f0 (table test-table [id=b799000a0ea54e149f049488092bc0d9]) successfully deleted
I20260811 12:45:17.970844 24398 ts_tablet_manager.cc:1918] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 12:45:17.971028 24398 log.cc:1196] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Deleting WAL directory at /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786451972721996-745-0/minicluster-data/ts-0/wal/wals/7a1a025a2b8741b6ae77ce06a19023f0
I20260811 12:45:17.971419 24053 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:18.064713 24398 ts_tablet_manager.cc:1939] T 7a1a025a2b8741b6ae77ce06a19023f0 P 545e2e8e65914612adb76db82c32c53e: Deleting consensus metadata
I20260811 12:45:18.065578 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 23920
W20260811 12:45:18.091356 23835 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.186.65:35239 (error 108)
I20260811 12:45:18.092260 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24065
I20260811 12:45:18.098361 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.096826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51016)
0811 12:45:18.097280 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.097665 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186}
W20260811 12:45:18.099478 23835 catalog_manager.cc:4584] TS 545e2e8e65914612adb76db82c32c53e (127.0.186.65:35239): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7a1a025a2b8741b6ae77ce06a19023f0: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
I20260811 12:45:18.107928 24368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.095762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38874 (local address 127.0.186.66:43263)
0811 12:45:18.096950 (+ 1188us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:18.096957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:18.096989 (+ 32us) server_negotiation.cc:407] Connection header received
0811 12:45:18.097087 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:18.097096 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:18.097237 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:18.097381 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:18.099461 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:18.101144 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:18.104148 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:18.104645 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:18.104846 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:18.106293 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:18.106304 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:18.106320 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:18.106983 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:18.107038 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:18.107061 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:18.107205 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:18.107377 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 12:45:18.107521 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260811 12:45:18.108902 24200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:18.154213 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.153585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51018)
0811 12:45:18.153858 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.153989 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 12:45:18.155448 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.155015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51028)
0811 12:45:18.155192 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.155284 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 12:45:18.210000 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24065
I20260811 12:45:18.216245 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.215606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51040)
0811 12:45:18.215880 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.216002 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 12:45:18.217521 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.217083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51048)
0811 12:45:18.217275 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.217367 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 12:45:18.235514 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24210
I20260811 12:45:18.244650 24371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.236616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50880 (local address 127.0.186.67:40491)
0811 12:45:18.236925 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:18.236933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:18.236961 (+ 28us) server_negotiation.cc:407] Connection header received
0811 12:45:18.237052 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:18.237059 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:18.237213 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:18.237386 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:18.237766 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:18.239113 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:18.240403 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:18.241290 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:18.241436 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:18.242693 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:18.242712 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:18.242734 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:18.243717 (+ 983us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:18.243792 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:18.243828 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:18.243955 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:18.244082 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 12:45:18.244204 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:45:18.245530 24345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:18.298429 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.297907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51064)
0811 12:45:18.298175 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.298265 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260811 12:45:18.299566 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.299149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51080)
0811 12:45:18.299385 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.299458 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 12:45:18.377286 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24210
I20260811 12:45:18.403566 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 23817
I20260811 12:45:18.404804 23888 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:18.519411 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:18.518210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.65:35239 (local address 127.0.0.1:51092)
0811 12:45:18.518842 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 12:45:18.518967 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.65:35239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414}
I20260811 12:45:18.519767 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 23817
2026-08-11T12:45:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3137 ms)
[----------] 6 tests from EncryptionPolicyTest (25149 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:18 dist-test-slave-qg60 krb5kdc[24410](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:18 dist-test-slave-qg60 krb5kdc[24410](info): set up 2 sockets
Aug 11 12:45:18 dist-test-slave-qg60 krb5kdc[24410](info): commencing operation
krb5kdc: starting...
W20260811 12:45:19.789474 745 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:20 dist-test-slave-qg60 krb5kdc[24410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:20.180939 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32829
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:20.545984 24427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:20.546293 24427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:20.546391 24427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:20.553907 24427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:20.554049 24427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:20.554100 24427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:20.554165 24427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:20.554212 24427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:20.564611 24427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32829
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:20.566004 24427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:20.567688 24427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:20.580330 24434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:20.580288 24437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:20.580243 24435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:20.581632 24427 server_base.cc:1034] running on GCE node
I20260811 12:45:20.582573 24427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:20.584129 24427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:20.585378 24427 hybrid_clock.cc:648] HybridClock initialized: now 1786452320585334 us; error 40 us; skew 500 ppm
I20260811 12:45:20.585784 24427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:20 dist-test-slave-qg60 krb5kdc[24410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452320, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:20.599370 24427 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:20.601297 24427 webserver.cc:460] Webserver started at http://127.0.0.1:38603/ using document root <none> and password file <none>
I20260811 12:45:20.602068 24427 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:20.602232 24427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:20.602596 24427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:20.605942 24427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "56cdc41e3a2a47db9ded2d41c85d2217"
format_stamp: "Formatted at 2026-08-11 12:45:20 on dist-test-slave-qg60"
server_key: "6b5e19574a962bcec24993f26d3863fc"
server_key_iv: "7fced0f1f71ffd28cd2005da7b5fab0d"
server_key_version: "encryptionkey@0"
I20260811 12:45:20.606773 24427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "56cdc41e3a2a47db9ded2d41c85d2217"
format_stamp: "Formatted at 2026-08-11 12:45:20 on dist-test-slave-qg60"
server_key: "6b5e19574a962bcec24993f26d3863fc"
server_key_iv: "7fced0f1f71ffd28cd2005da7b5fab0d"
server_key_version: "encryptionkey@0"
I20260811 12:45:20.612341 24427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:45:20.616214 24444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:20.617767 24427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 12:45:20.617986 24427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "56cdc41e3a2a47db9ded2d41c85d2217"
format_stamp: "Formatted at 2026-08-11 12:45:20 on dist-test-slave-qg60"
server_key: "6b5e19574a962bcec24993f26d3863fc"
server_key_iv: "7fced0f1f71ffd28cd2005da7b5fab0d"
server_key_version: "encryptionkey@0"
I20260811 12:45:20.618235 24427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:20.630672 24427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:20.635838 24427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:20.636174 24427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:20.656840 24427 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32829
I20260811 12:45:20.656848 24504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32829 every 8 connection(s)
I20260811 12:45:20.658366 24427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:20.662391 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:20.668576 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24427
I20260811 12:45:20.668902 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:20.669628 745 external_mini_cluster.cc:1428] Setting key 4174337d60bc01e4e863b9d8471249d6
I20260811 12:45:20.674499 24505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217: Bootstrap starting.
I20260811 12:45:20.678614 24505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:20.679901 24505 log.cc:824] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:20.683152 24505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217: No bootstrap required, opened a new log
Aug 11 12:45:20 dist-test-slave-qg60 krb5kdc[24410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 12:45:20.691908 24505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32829 } }
I20260811 12:45:20.692343 24505 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:20.692476 24505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56cdc41e3a2a47db9ded2d41c85d2217, State: Initialized, Role: FOLLOWER
I20260811 12:45:20.693200 24505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32829 } }
I20260811 12:45:20.693472 24505 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:20.693619 24505 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:20.693828 24505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:20.696208 24509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:20.671974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41009 (local address 127.0.0.1:32829)
0811 12:45:20.672935 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:20.672948 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:20.672993 (+ 45us) server_negotiation.cc:407] Connection header received
0811 12:45:20.674902 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:20.674928 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:20.675369 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:20.675739 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:20.677796 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:20.679266 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:20.681178 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:20.681873 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:20.682099 (+ 226us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:20.687021 (+ 4922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:20.687030 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:20.687046 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:20.687090 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:20.690789 (+ 3699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:20.691769 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:20.691776 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:20.691784 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:20.691970 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:20.692590 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:20.692597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:20.692602 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:20.693484 (+ 882us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:20.693879 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:20.694729 (+ 850us) server_negotiation.cc:299] Negotiation successful
0811 12:45:20.695095 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":459,"threads_started":1}
I20260811 12:45:20.696594 24505 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32829 } }
I20260811 12:45:20.697161 24505 leader_election.cc:302] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56cdc41e3a2a47db9ded2d41c85d2217; no voters:
I20260811 12:45:20.698036 24505 leader_election.cc:288] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:20.698221 24511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:20.700248 24511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [term 1 LEADER]: Becoming Leader. State: Replica: 56cdc41e3a2a47db9ded2d41c85d2217, State: Running, Role: LEADER
I20260811 12:45:20.700412 24505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:20.700878 24511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32829 } }
I20260811 12:45:20.701288 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:20.703723 24513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56cdc41e3a2a47db9ded2d41c85d2217. Latest consensus state: current_term: 1 leader_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32829 } } }
I20260811 12:45:20.704160 24513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:20.704758 24512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56cdc41e3a2a47db9ded2d41c85d2217" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32829 } } }
I20260811 12:45:20.705047 24512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:20.712874 24518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:20.718758 24518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:20.757113 24518 catalog_manager.cc:1347] Generated new cluster ID: 79e7ddcbfabf40efbdb2599ca2d15c41
I20260811 12:45:20.757243 24518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:20.758214 24509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:20.721720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39041 (local address 127.0.0.1:32829)
0811 12:45:20.721931 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:20.721940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:20.732861 (+ 10921us) server_negotiation.cc:407] Connection header received
0811 12:45:20.733509 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:20.733518 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:20.733647 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:20.733744 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:20.736639 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:20.738301 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:20.741354 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:20.742105 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:20.742246 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:20.747210 (+ 4964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:20.747220 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:20.747229 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:20.747302 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:20.752603 (+ 5301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:20.754294 (+ 1691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:20.754304 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:20.754311 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:20.754543 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:20.755350 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:20.755358 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:20.755364 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:20.755994 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:20.756366 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:20.757347 (+ 981us) server_negotiation.cc:299] Negotiation successful
0811 12:45:20.757639 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 12:45:20.782202 24518 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:20.783569 24518 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:20.803731 24518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56cdc41e3a2a47db9ded2d41c85d2217: Generated new TSK 0
I20260811 12:45:20.804885 24518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:20.813421 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24427
I20260811 12:45:20.815351 24500 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:20.914778 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24427
W20260811 12:45:20.937479 24408 connection.cc:535] client connection to 127.0.0.1:32829 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32829): Connection reset by peer (error 104)
2026-08-11T12:45:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2384 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:21 dist-test-slave-qg60 krb5kdc[24543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:21 dist-test-slave-qg60 krb5kdc[24543](info): set up 2 sockets
Aug 11 12:45:21 dist-test-slave-qg60 krb5kdc[24543](info): commencing operation
krb5kdc: starting...
W20260811 12:45:22.175269 745 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.002s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:22 dist-test-slave-qg60 krb5kdc[24543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:22.568392 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:22.932328 24558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:22.932746 24558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:22.932994 24558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:22.940685 24558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:22.940920 24558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:22.941041 24558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:22.941166 24558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:22.941255 24558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:22.952118 24558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37459
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:22.953687 24558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:22.955178 24558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:22.968044 24564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:22.967993 24565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:22.968084 24567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:22.969503 24558 server_base.cc:1034] running on GCE node
I20260811 12:45:22.970430 24558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:22.972070 24558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:22.973304 24558 hybrid_clock.cc:648] HybridClock initialized: now 1786452322973262 us; error 31 us; skew 500 ppm
I20260811 12:45:22.973721 24558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:22 dist-test-slave-qg60 krb5kdc[24543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452322, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:22.977360 24558 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:22.979043 24558 webserver.cc:460] Webserver started at http://127.0.0.1:34401/ using document root <none> and password file <none>
I20260811 12:45:22.979800 24558 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:22.979959 24558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:22.980294 24558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:22.983532 24558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "1b4aee9902c54398bfccacf6095c63fe"
format_stamp: "Formatted at 2026-08-11 12:45:22 on dist-test-slave-qg60"
server_key: "6e51f6cbe60f8188dc0c55d23b3a0d61"
server_key_iv: "40c561e05f8ab8f3e5cf8513446cc9d1"
server_key_version: "encryptionkey@0"
I20260811 12:45:22.984381 24558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "1b4aee9902c54398bfccacf6095c63fe"
format_stamp: "Formatted at 2026-08-11 12:45:22 on dist-test-slave-qg60"
server_key: "6e51f6cbe60f8188dc0c55d23b3a0d61"
server_key_iv: "40c561e05f8ab8f3e5cf8513446cc9d1"
server_key_version: "encryptionkey@0"
I20260811 12:45:22.990226 24558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 12:45:22.994347 24574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:22.996054 24558 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260811 12:45:22.996284 24558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "1b4aee9902c54398bfccacf6095c63fe"
format_stamp: "Formatted at 2026-08-11 12:45:22 on dist-test-slave-qg60"
server_key: "6e51f6cbe60f8188dc0c55d23b3a0d61"
server_key_iv: "40c561e05f8ab8f3e5cf8513446cc9d1"
server_key_version: "encryptionkey@0"
I20260811 12:45:22.996538 24558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:23.037802 24558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:23.042709 24558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:23.043061 24558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:23.064252 24558 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37459
I20260811 12:45:23.064289 24632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37459 every 8 connection(s)
I20260811 12:45:23.065805 24558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:23.066644 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24558
I20260811 12:45:23.066865 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:23.067430 745 external_mini_cluster.cc:1428] Setting key 447bdce1cc25aba2f6267ff81110274b
I20260811 12:45:23.070771 24634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:23.082326 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:23.069462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53943 (local address 127.0.0.1:37459)
0811 12:45:23.070335 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:23.070347 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:23.070390 (+ 43us) server_negotiation.cc:407] Connection header received
0811 12:45:23.072170 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:23.072193 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:23.072607 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:23.072996 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:23.073655 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:23.075162 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:23.077140 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:23.078183 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:23.078318 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:23.079716 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:23.079724 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:23.079738 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:23.080298 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:23.080385 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:23.080414 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:23.080539 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:23.080959 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 12:45:23.081240 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":399,"threads_started":1}
I20260811 12:45:23.084153 24634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe: Bootstrap starting.
I20260811 12:45:23.086541 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:23.087916 24634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:23.089345 24634 log.cc:824] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:23.093041 24634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe: No bootstrap required, opened a new log
I20260811 12:45:23.098999 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:23.092277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58773 (local address 127.0.0.1:37459)
0811 12:45:23.092507 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:23.092516 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:23.092946 (+ 430us) server_negotiation.cc:407] Connection header received
0811 12:45:23.093166 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:23.093174 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:23.093252 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:23.093359 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:23.093969 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:23.094769 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:23.096152 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:23.096639 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:23.096823 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:23.098178 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:23.098187 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:23.098191 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:23.098218 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:23.098276 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:23.098291 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:23.098442 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:23.098642 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 12:45:23.098701 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 12:45:23.101810 24634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4aee9902c54398bfccacf6095c63fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37459 } }
I20260811 12:45:23.102231 24634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:23.102348 24634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b4aee9902c54398bfccacf6095c63fe, State: Initialized, Role: FOLLOWER
I20260811 12:45:23.102999 24634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4aee9902c54398bfccacf6095c63fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37459 } }
I20260811 12:45:23.103263 24634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:23.103428 24634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:23.103626 24634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:23.106817 24634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4aee9902c54398bfccacf6095c63fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37459 } }
I20260811 12:45:23.107378 24634 leader_election.cc:302] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b4aee9902c54398bfccacf6095c63fe; no voters:
I20260811 12:45:23.108011 24634 leader_election.cc:288] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:23.108204 24646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:23.109476 24646 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [term 1 LEADER]: Becoming Leader. State: Replica: 1b4aee9902c54398bfccacf6095c63fe, State: Running, Role: LEADER
I20260811 12:45:23.110056 24646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4aee9902c54398bfccacf6095c63fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37459 } }
I20260811 12:45:23.110374 24634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:23.113734 24649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b4aee9902c54398bfccacf6095c63fe. Latest consensus state: current_term: 1 leader_uuid: "1b4aee9902c54398bfccacf6095c63fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4aee9902c54398bfccacf6095c63fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37459 } } }
I20260811 12:45:23.113858 24647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b4aee9902c54398bfccacf6095c63fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4aee9902c54398bfccacf6095c63fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37459 } } }
I20260811 12:45:23.114830 24649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:23.115029 24647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:23.120963 24654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:23.127381 24654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:23.137439 24654 catalog_manager.cc:1347] Generated new cluster ID: 8536fb88cfe646b8bd1c3dc734cc453b
I20260811 12:45:23.137595 24654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:23.159227 24654 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:23.160777 24654 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:23.167712 24654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b4aee9902c54398bfccacf6095c63fe: Generated new TSK 0
I20260811 12:45:23.168605 24654 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:23.176455 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24558
W20260811 12:45:23.177835 24628 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53943
W20260811 12:45:23.178797 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24558: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:23.179046 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24558
W20260811 12:45:23.202891 24541 connection.cc:535] client connection to 127.0.0.1:37459 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37459): Connection reset by peer (error 104)
2026-08-11T12:45:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2265 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:23 dist-test-slave-qg60 krb5kdc[24671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:23 dist-test-slave-qg60 krb5kdc[24671](info): set up 2 sockets
Aug 11 12:45:23 dist-test-slave-qg60 krb5kdc[24671](info): commencing operation
krb5kdc: starting...
W20260811 12:45:24.422901 745 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.002s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:24 dist-test-slave-qg60 krb5kdc[24671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:24.804512 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38065
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:25.163882 24685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:25.164206 24685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:25.164311 24685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:25.171782 24685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:25.171904 24685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:25.171952 24685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:25.172008 24685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:25.172058 24685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:25.182258 24685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38065
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:25.183609 24685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:25.184965 24685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:25.197332 24692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:25.197549 24694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:25.197455 24691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:25.198760 24685 server_base.cc:1034] running on GCE node
I20260811 12:45:25.199671 24685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:25.201316 24685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:25.202746 24685 hybrid_clock.cc:648] HybridClock initialized: now 1786452325202526 us; error 52 us; skew 500 ppm
I20260811 12:45:25.203240 24685 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:25 dist-test-slave-qg60 krb5kdc[24671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452325, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:25.212276 24685 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:25.214200 24685 webserver.cc:460] Webserver started at http://127.0.0.1:37009/ using document root <none> and password file <none>
I20260811 12:45:25.215003 24685 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:25.215171 24685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:25.215523 24685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:25.218760 24685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "0b0e2650874a4b799806761f4b94e4d2"
format_stamp: "Formatted at 2026-08-11 12:45:25 on dist-test-slave-qg60"
server_key: "6fdb52cee1f5b263e5d20408f9a62200"
server_key_iv: "30fe7856681846f3c207ceddb3a85e09"
server_key_version: "encryptionkey@0"
I20260811 12:45:25.219601 24685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "0b0e2650874a4b799806761f4b94e4d2"
format_stamp: "Formatted at 2026-08-11 12:45:25 on dist-test-slave-qg60"
server_key: "6fdb52cee1f5b263e5d20408f9a62200"
server_key_iv: "30fe7856681846f3c207ceddb3a85e09"
server_key_version: "encryptionkey@0"
I20260811 12:45:25.225574 24685 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 12:45:25.229549 24701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:25.231204 24685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 12:45:25.231431 24685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "0b0e2650874a4b799806761f4b94e4d2"
format_stamp: "Formatted at 2026-08-11 12:45:25 on dist-test-slave-qg60"
server_key: "6fdb52cee1f5b263e5d20408f9a62200"
server_key_iv: "30fe7856681846f3c207ceddb3a85e09"
server_key_version: "encryptionkey@0"
I20260811 12:45:25.231674 24685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:25.238452 24685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:25.242880 24685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:25.243224 24685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:25.263707 24685 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38065
I20260811 12:45:25.263761 24756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38065 every 8 connection(s)
I20260811 12:45:25.265254 24685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:25.269347 24757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:25.271773 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24685
I20260811 12:45:25.271986 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:25.272567 745 external_mini_cluster.cc:1428] Setting key 45f178e4cbdf9849cff82e22d38c082a
I20260811 12:45:25.281970 24761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:25.274872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55697 (local address 127.0.0.1:38065)
0811 12:45:25.275778 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:25.275792 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:25.275841 (+ 49us) server_negotiation.cc:407] Connection header received
0811 12:45:25.277866 (+ 2025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:25.277896 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:25.278350 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:25.278792 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:25.280047 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:25.280054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:25.280068 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:25.280091 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:25.280180 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:25.280202 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:25.280454 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:25.280606 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 12:45:25.280876 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":369,"threads_started":1}
I20260811 12:45:25.284914 24757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2: Bootstrap starting.
I20260811 12:45:25.286121 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:25.288242 24757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:25.289626 24757 log.cc:824] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:25.292645 24757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2: No bootstrap required, opened a new log
I20260811 12:45:25.295387 24761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:25.290747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52085 (local address 127.0.0.1:38065)
0811 12:45:25.290969 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:25.290979 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:25.293257 (+ 2278us) server_negotiation.cc:407] Connection header received
0811 12:45:25.293468 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:25.293473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:25.293535 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:25.293640 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:25.294659 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:25.294664 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:25.294669 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:25.294695 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:25.294737 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:25.294754 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:25.294889 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:25.294988 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 12:45:25.295056 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 12:45:25.300926 24757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2650874a4b799806761f4b94e4d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38065 } }
I20260811 12:45:25.301399 24757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:25.301514 24757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0e2650874a4b799806761f4b94e4d2, State: Initialized, Role: FOLLOWER
I20260811 12:45:25.302204 24757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2650874a4b799806761f4b94e4d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38065 } }
I20260811 12:45:25.302516 24757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:25.302699 24757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:25.302904 24757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:25.305469 24757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2650874a4b799806761f4b94e4d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38065 } }
I20260811 12:45:25.305950 24757 leader_election.cc:302] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b0e2650874a4b799806761f4b94e4d2; no voters:
I20260811 12:45:25.306517 24757 leader_election.cc:288] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:25.306705 24769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:25.307497 24769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0b0e2650874a4b799806761f4b94e4d2, State: Running, Role: LEADER
I20260811 12:45:25.308128 24769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2650874a4b799806761f4b94e4d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38065 } }
I20260811 12:45:25.309031 24757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:25.311470 24771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b0e2650874a4b799806761f4b94e4d2. Latest consensus state: current_term: 1 leader_uuid: "0b0e2650874a4b799806761f4b94e4d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2650874a4b799806761f4b94e4d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38065 } } }
I20260811 12:45:25.312261 24771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:25.311681 24770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b0e2650874a4b799806761f4b94e4d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2650874a4b799806761f4b94e4d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38065 } } }
I20260811 12:45:25.312695 24770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:25.317341 24778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:25.322332 24778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:25.333252 24778 catalog_manager.cc:1347] Generated new cluster ID: 992ddc22387d4ac087b4a76ddfff4ceb
I20260811 12:45:25.333492 24778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:25.359297 24778 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:25.359920 24778 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:25.381835 24778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b0e2650874a4b799806761f4b94e4d2: Generated new TSK 0
I20260811 12:45:25.382992 24778 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:25.399977 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24685
W20260811 12:45:25.401530 24752 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55697
W20260811 12:45:25.402284 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24685: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:25.402442 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24685
2026-08-11T12:45:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2219 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:25 dist-test-slave-qg60 krb5kdc[24791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:25 dist-test-slave-qg60 krb5kdc[24791](info): set up 2 sockets
Aug 11 12:45:25 dist-test-slave-qg60 krb5kdc[24791](info): commencing operation
krb5kdc: starting...
W20260811 12:45:26.631053 745 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.002s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:26 dist-test-slave-qg60 krb5kdc[24791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:27.025390 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40445
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:27.411432 24809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:27.411795 24809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:27.411983 24809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:27.420498 24809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:27.420641 24809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:27.420745 24809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:27.420895 24809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:27.420998 24809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:27.433221 24809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:27.434778 24809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:27.436295 24809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:27.450734 24814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:27.450847 24815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:27.450855 24817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:27.452221 24809 server_base.cc:1034] running on GCE node
I20260811 12:45:27.453387 24809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:27.455029 24809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:27.456326 24809 hybrid_clock.cc:648] HybridClock initialized: now 1786452327456268 us; error 49 us; skew 500 ppm
I20260811 12:45:27.456795 24809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:27 dist-test-slave-qg60 krb5kdc[24791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452327, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:27.467309 24809 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:27.469259 24809 webserver.cc:460] Webserver started at http://127.0.0.1:39927/ using document root <none> and password file <none>
I20260811 12:45:27.470045 24809 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:27.470165 24809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:27.470448 24809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:27.473827 24809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "6031c89f8fc345f2b60c65f343d9ef9f"
format_stamp: "Formatted at 2026-08-11 12:45:27 on dist-test-slave-qg60"
server_key: "bd3cc424b000bde3a59e3811c03d4b18"
server_key_iv: "1aba82d062126554cf2aecac808a6029"
server_key_version: "encryptionkey@0"
I20260811 12:45:27.474629 24809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "6031c89f8fc345f2b60c65f343d9ef9f"
format_stamp: "Formatted at 2026-08-11 12:45:27 on dist-test-slave-qg60"
server_key: "bd3cc424b000bde3a59e3811c03d4b18"
server_key_iv: "1aba82d062126554cf2aecac808a6029"
server_key_version: "encryptionkey@0"
I20260811 12:45:27.481172 24809 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 12:45:27.485235 24824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:27.486933 24809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:45:27.487165 24809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "6031c89f8fc345f2b60c65f343d9ef9f"
format_stamp: "Formatted at 2026-08-11 12:45:27 on dist-test-slave-qg60"
server_key: "bd3cc424b000bde3a59e3811c03d4b18"
server_key_iv: "1aba82d062126554cf2aecac808a6029"
server_key_version: "encryptionkey@0"
I20260811 12:45:27.487409 24809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:27.503925 24809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:27.508944 24809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:27.509269 24809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:27.529989 24809 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40445
I20260811 12:45:27.530030 24879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40445 every 8 connection(s)
I20260811 12:45:27.531540 24809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:27.536157 24880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:27.537138 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24809
I20260811 12:45:27.537352 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:27.537849 745 external_mini_cluster.cc:1428] Setting key 9716ee0e9a2a97c98fb4123bea176132
I20260811 12:45:27.553275 24880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f: Bootstrap starting.
Aug 11 12:45:27 dist-test-slave-qg60 krb5kdc[24791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 12:45:27.557710 24880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:27.559410 24880 log.cc:824] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:27.563405 24880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f: No bootstrap required, opened a new log
I20260811 12:45:27.567342 24883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:27.540035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35647 (local address 127.0.0.1:40445)
0811 12:45:27.541212 (+ 1177us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:27.541230 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:27.541616 (+ 386us) server_negotiation.cc:407] Connection header received
0811 12:45:27.543809 (+ 2193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:27.543844 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:27.544492 (+ 648us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:27.545101 (+ 609us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:27.546453 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:27.548786 (+ 2333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:27.550277 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:27.551628 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:27.551854 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:27.556781 (+ 4927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:27.556799 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:27.556821 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:27.556881 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:27.561615 (+ 4734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:27.562510 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:27.562519 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:27.562529 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:27.562772 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:27.563356 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:27.563363 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:27.563368 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:27.564290 (+ 922us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:27.564651 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:27.565142 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 12:45:27.565701 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":867,"thread_start_us":457,"threads_started":1}
I20260811 12:45:27.571846 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:27.574484 24880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40445 } }
I20260811 12:45:27.575030 24880 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:27.575255 24880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6031c89f8fc345f2b60c65f343d9ef9f, State: Initialized, Role: FOLLOWER
I20260811 12:45:27.576032 24880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40445 } }
I20260811 12:45:27.576327 24880 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:27.576510 24880 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:27.576818 24880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:27.579514 24880 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40445 } }
I20260811 12:45:27.580281 24880 leader_election.cc:302] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6031c89f8fc345f2b60c65f343d9ef9f; no voters:
I20260811 12:45:27.581130 24880 leader_election.cc:288] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:27.581274 24894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:27.583185 24894 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [term 1 LEADER]: Becoming Leader. State: Replica: 6031c89f8fc345f2b60c65f343d9ef9f, State: Running, Role: LEADER
I20260811 12:45:27.584103 24894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40445 } }
I20260811 12:45:27.584347 24880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:27.588690 24896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6031c89f8fc345f2b60c65f343d9ef9f. Latest consensus state: current_term: 1 leader_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40445 } } }
I20260811 12:45:27.589308 24896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:27.590008 24895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6031c89f8fc345f2b60c65f343d9ef9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40445 } } }
I20260811 12:45:27.590457 24895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:27.591809 24902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:27.598093 24883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:27.576855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48749 (local address 127.0.0.1:40445)
0811 12:45:27.577086 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:27.577097 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:27.580390 (+ 3293us) server_negotiation.cc:407] Connection header received
0811 12:45:27.580651 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:27.580655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:27.580766 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:27.580907 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:27.582903 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:27.583888 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:27.585312 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:27.585805 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:27.585954 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:27.589832 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:27.589838 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:27.589841 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:27.589902 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:27.595043 (+ 5141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:27.595821 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:27.595826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:27.595830 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:27.595972 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:27.596429 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:27.596434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:27.596437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:27.596849 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:27.597104 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:27.597495 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 12:45:27.597726 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":69}
I20260811 12:45:27.608330 24902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:27.618472 24902 catalog_manager.cc:1347] Generated new cluster ID: 005553c92c2f4f42bd494f87bb14d9ff
I20260811 12:45:27.618610 24902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:27.653383 24902 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:27.654847 24902 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:27.666647 24902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6031c89f8fc345f2b60c65f343d9ef9f: Generated new TSK 0
I20260811 12:45:27.667639 24902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:27.682145 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24809
I20260811 12:45:27.683314 24875 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:27.781951 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24809
2026-08-11T12:45:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2383 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:27 dist-test-slave-qg60 krb5kdc[24920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:27 dist-test-slave-qg60 krb5kdc[24920](info): set up 2 sockets
Aug 11 12:45:27 dist-test-slave-qg60 krb5kdc[24920](info): commencing operation
krb5kdc: starting...
W20260811 12:45:29.055439 745 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:29 dist-test-slave-qg60 krb5kdc[24920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:29.452282 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33659
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:29.814494 24933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:29.814790 24933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:29.814882 24933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:29.822276 24933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:29.822403 24933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:29.822451 24933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:29.822522 24933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:29.822568 24933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:29.832777 24933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:29.834182 24933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:29.835547 24933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:29.848372 24942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:29.848416 24944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:29.848326 24941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:29.849599 24933 server_base.cc:1034] running on GCE node
I20260811 12:45:29.850477 24933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:29.852123 24933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:29.853386 24933 hybrid_clock.cc:648] HybridClock initialized: now 1786452329853332 us; error 44 us; skew 500 ppm
I20260811 12:45:29.853776 24933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:29 dist-test-slave-qg60 krb5kdc[24920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452329, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:29.857371 24933 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:29.859140 24933 webserver.cc:460] Webserver started at http://127.0.0.1:34821/ using document root <none> and password file <none>
I20260811 12:45:29.859891 24933 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:29.860059 24933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:29.860412 24933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:29.863704 24933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "87f5fec83ded4995a54822b912b06efe"
format_stamp: "Formatted at 2026-08-11 12:45:29 on dist-test-slave-qg60"
server_key: "d920b6e90f4aa66d236c127b7e24c458"
server_key_iv: "960e71aca5c1859b0fcf2840d4e5ee38"
server_key_version: "encryptionkey@0"
I20260811 12:45:29.864574 24933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "87f5fec83ded4995a54822b912b06efe"
format_stamp: "Formatted at 2026-08-11 12:45:29 on dist-test-slave-qg60"
server_key: "d920b6e90f4aa66d236c127b7e24c458"
server_key_iv: "960e71aca5c1859b0fcf2840d4e5ee38"
server_key_version: "encryptionkey@0"
I20260811 12:45:29.870486 24933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 12:45:29.874248 24952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:29.875661 24933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:29.875873 24933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "87f5fec83ded4995a54822b912b06efe"
format_stamp: "Formatted at 2026-08-11 12:45:29 on dist-test-slave-qg60"
server_key: "d920b6e90f4aa66d236c127b7e24c458"
server_key_iv: "960e71aca5c1859b0fcf2840d4e5ee38"
server_key_version: "encryptionkey@0"
I20260811 12:45:29.876160 24933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:29.906175 24933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:29.910996 24933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:29.911439 24933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:29.933300 24933 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33659
I20260811 12:45:29.933334 25011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33659 every 8 connection(s)
I20260811 12:45:29.934777 24933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:29.938673 25012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:29.941272 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 24933
I20260811 12:45:29.941483 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:29.942068 745 external_mini_cluster.cc:1428] Setting key f30a9cc325608c4709463851540eee72
I20260811 12:45:29.953300 25012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe: Bootstrap starting.
I20260811 12:45:29.957405 25012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:29.958662 25012 log.cc:824] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:29.959388 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:29.944600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49159 (local address 127.0.0.1:33659)
0811 12:45:29.945706 (+ 1106us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:29.945721 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:29.946205 (+ 484us) server_negotiation.cc:407] Connection header received
0811 12:45:29.948475 (+ 2270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:29.948506 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:29.949122 (+ 616us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:29.949582 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:29.950143 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:29.952228 (+ 2085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:29.953861 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:29.954880 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:29.955126 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:29.956404 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:29.956418 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:29.956438 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:29.957174 (+ 736us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:29.957289 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:29.957324 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:29.957467 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:29.957860 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 12:45:29.958186 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":834,"thread_start_us":489,"threads_started":1}
I20260811 12:45:29.962154 25012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe: No bootstrap required, opened a new log
I20260811 12:45:29.963876 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:29.973548 25012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f5fec83ded4995a54822b912b06efe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33659 } }
I20260811 12:45:29.973976 25012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:29.974152 25012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87f5fec83ded4995a54822b912b06efe, State: Initialized, Role: FOLLOWER
I20260811 12:45:29.975014 25012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f5fec83ded4995a54822b912b06efe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33659 } }
I20260811 12:45:29.975350 25012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:29.975528 25012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:29.975732 25012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:29.977548 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:29.969970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51835 (local address 127.0.0.1:33659)
0811 12:45:29.970181 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:29.970189 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:29.970772 (+ 583us) server_negotiation.cc:407] Connection header received
0811 12:45:29.970915 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:29.970923 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:29.971037 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:29.971167 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:29.971729 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:29.972889 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:29.974487 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:29.975162 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:29.975307 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:29.976643 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:29.976649 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:29.976654 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:29.976686 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:29.976784 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:29.976809 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:29.976909 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:29.977083 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 12:45:29.977190 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 12:45:29.979080 25012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f5fec83ded4995a54822b912b06efe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33659 } }
I20260811 12:45:29.979672 25012 leader_election.cc:302] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87f5fec83ded4995a54822b912b06efe; no voters:
I20260811 12:45:29.980459 25012 leader_election.cc:288] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:29.980603 25023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:29.981572 25023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [term 1 LEADER]: Becoming Leader. State: Replica: 87f5fec83ded4995a54822b912b06efe, State: Running, Role: LEADER
I20260811 12:45:29.982286 25023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f5fec83ded4995a54822b912b06efe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33659 } }
I20260811 12:45:29.982818 25012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:29.986101 25024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87f5fec83ded4995a54822b912b06efe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f5fec83ded4995a54822b912b06efe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33659 } } }
I20260811 12:45:29.986500 25024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:29.987141 25025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f5fec83ded4995a54822b912b06efe. Latest consensus state: current_term: 1 leader_uuid: "87f5fec83ded4995a54822b912b06efe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f5fec83ded4995a54822b912b06efe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33659 } } }
I20260811 12:45:29.987469 25025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:29.994176 25034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:30.000680 25034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:30.011947 25034 catalog_manager.cc:1347] Generated new cluster ID: 8da85225487e4d389788d15dfaba2819
I20260811 12:45:30.012099 25034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:30.065516 25034 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:30.067111 25034 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:30.079723 25034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87f5fec83ded4995a54822b912b06efe: Generated new TSK 0
I20260811 12:45:30.080780 25034 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:30.104628 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24933
W20260811 12:45:30.105906 25007 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49159
W20260811 12:45:30.106689 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 24933: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:30.106842 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 24933
2026-08-11T12:45:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:30 dist-test-slave-qg60 krb5kdc[25048](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:30 dist-test-slave-qg60 krb5kdc[25048](info): set up 2 sockets
Aug 11 12:45:30 dist-test-slave-qg60 krb5kdc[25048](info): commencing operation
krb5kdc: starting...
W20260811 12:45:31.483848 745 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.009s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:31 dist-test-slave-qg60 krb5kdc[25048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:31.885427 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34135
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:32.258558 25063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:32.258917 25063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:32.259115 25063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:32.266695 25063 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:32.266824 25063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:32.266952 25063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:32.267072 25063 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:32.267134 25063 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:32.277405 25063 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:32.278930 25063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:32.280385 25063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:32.293608 25068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:32.293519 25071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:32.293648 25069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:32.295123 25063 server_base.cc:1034] running on GCE node
I20260811 12:45:32.296046 25063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:32.297736 25063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:32.298985 25063 hybrid_clock.cc:648] HybridClock initialized: now 1786452332298891 us; error 95 us; skew 500 ppm
I20260811 12:45:32.299369 25063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:32 dist-test-slave-qg60 krb5kdc[25048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452332, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:32.302917 25063 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:32.304610 25063 webserver.cc:460] Webserver started at http://127.0.0.1:40155/ using document root <none> and password file <none>
I20260811 12:45:32.305445 25063 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:32.305614 25063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:32.305950 25063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:32.309238 25063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "a556a07c5cbe4e16839bcf56e35510bd"
format_stamp: "Formatted at 2026-08-11 12:45:32 on dist-test-slave-qg60"
server_key: "3bd1dfc712f619f11d30ccda95d75f52"
server_key_iv: "bdf4bd5b73875cde1870c5f4af9096a4"
server_key_version: "encryptionkey@0"
I20260811 12:45:32.310102 25063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "a556a07c5cbe4e16839bcf56e35510bd"
format_stamp: "Formatted at 2026-08-11 12:45:32 on dist-test-slave-qg60"
server_key: "3bd1dfc712f619f11d30ccda95d75f52"
server_key_iv: "bdf4bd5b73875cde1870c5f4af9096a4"
server_key_version: "encryptionkey@0"
I20260811 12:45:32.315968 25063 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 12:45:32.320130 25078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:32.321784 25063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 12:45:32.321943 25063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "a556a07c5cbe4e16839bcf56e35510bd"
format_stamp: "Formatted at 2026-08-11 12:45:32 on dist-test-slave-qg60"
server_key: "3bd1dfc712f619f11d30ccda95d75f52"
server_key_iv: "bdf4bd5b73875cde1870c5f4af9096a4"
server_key_version: "encryptionkey@0"
I20260811 12:45:32.322171 25063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:32.328848 25063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:32.333366 25063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:32.333647 25063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:32.354141 25063 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34135
I20260811 12:45:32.354241 25139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34135 every 8 connection(s)
I20260811 12:45:32.355672 25063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:32.356252 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25063
I20260811 12:45:32.356492 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:32.357211 745 external_mini_cluster.cc:1428] Setting key 11fbf5ed38dc33db371ae6f0bffd7578
I20260811 12:45:32.361268 25140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:32.367777 25144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:32.359380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36195 (local address 127.0.0.1:34135)
0811 12:45:32.360364 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:32.360380 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:32.360438 (+ 58us) server_negotiation.cc:407] Connection header received
0811 12:45:32.363254 (+ 2816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:32.363287 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:32.363770 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:32.364285 (+ 515us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:32.365528 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:32.365537 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:32.365555 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:32.365583 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:32.365687 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:32.365716 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:32.365968 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:32.366133 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 12:45:32.366374 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":393,"threads_started":1}
I20260811 12:45:32.372023 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:32.376612 25140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd: Bootstrap starting.
I20260811 12:45:32.379758 25144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:32.376827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44799 (local address 127.0.0.1:34135)
0811 12:45:32.377060 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:32.377069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:32.377544 (+ 475us) server_negotiation.cc:407] Connection header received
0811 12:45:32.377762 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:32.377766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:32.377821 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:32.377901 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:32.379030 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:32.379034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:32.379037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:32.379052 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:32.379090 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:32.379113 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:32.379218 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:32.379381 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 12:45:32.379431 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:45:32.381301 25140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:32.382467 25140 log.cc:824] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:32.385836 25140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd: No bootstrap required, opened a new log
I20260811 12:45:32.394493 25140 raft_consensus.cc:348] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a556a07c5cbe4e16839bcf56e35510bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34135 } }
I20260811 12:45:32.395016 25140 raft_consensus.cc:374] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:32.395143 25140 raft_consensus.cc:729] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a556a07c5cbe4e16839bcf56e35510bd, State: Initialized, Role: FOLLOWER
I20260811 12:45:32.395880 25140 consensus_queue.cc:260] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a556a07c5cbe4e16839bcf56e35510bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34135 } }
I20260811 12:45:32.396178 25140 raft_consensus.cc:388] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:32.396364 25140 raft_consensus.cc:482] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:32.396585 25140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:32.399437 25140 raft_consensus.cc:504] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a556a07c5cbe4e16839bcf56e35510bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34135 } }
I20260811 12:45:32.400187 25140 leader_election.cc:302] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a556a07c5cbe4e16839bcf56e35510bd; no voters:
I20260811 12:45:32.400844 25140 leader_election.cc:288] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:32.401065 25152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:32.402005 25152 raft_consensus.cc:686] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [term 1 LEADER]: Becoming Leader. State: Replica: a556a07c5cbe4e16839bcf56e35510bd, State: Running, Role: LEADER
I20260811 12:45:32.402596 25152 consensus_queue.cc:237] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a556a07c5cbe4e16839bcf56e35510bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34135 } }
I20260811 12:45:32.403213 25140 sys_catalog.cc:564] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:32.405706 25154 sys_catalog.cc:455] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a556a07c5cbe4e16839bcf56e35510bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a556a07c5cbe4e16839bcf56e35510bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34135 } } }
I20260811 12:45:32.406157 25154 sys_catalog.cc:458] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:32.406906 25155 sys_catalog.cc:455] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a556a07c5cbe4e16839bcf56e35510bd. Latest consensus state: current_term: 1 leader_uuid: "a556a07c5cbe4e16839bcf56e35510bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a556a07c5cbe4e16839bcf56e35510bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34135 } } }
I20260811 12:45:32.407486 25155 sys_catalog.cc:458] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:32.409883 25161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:32.420977 25161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:32.431263 25161 catalog_manager.cc:1347] Generated new cluster ID: f97535621e7e43e4be8d088daf67e340
I20260811 12:45:32.431417 25161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:32.449787 25161 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:32.450343 25161 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:32.464771 25161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a556a07c5cbe4e16839bcf56e35510bd: Generated new TSK 0
I20260811 12:45:32.466003 25161 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:32.488309 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25063
W20260811 12:45:32.489826 25132 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36195
W20260811 12:45:32.490700 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25063: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:32.490898 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25063
2026-08-11T12:45:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2386 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:32 dist-test-slave-qg60 krb5kdc[25176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:32 dist-test-slave-qg60 krb5kdc[25176](info): set up 2 sockets
Aug 11 12:45:32 dist-test-slave-qg60 krb5kdc[25176](info): commencing operation
krb5kdc: starting...
W20260811 12:45:33.758591 745 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.007s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:34 dist-test-slave-qg60 krb5kdc[25176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:34.156423 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33755
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:34.528561 25190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:34.529006 25190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:34.529187 25190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:34.537173 25190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:34.537300 25190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:34.537428 25190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:34.537532 25190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:34.537600 25190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:34.548384 25190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:34.549891 25190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:34.551348 25190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:34.564057 25195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:34.563985 25196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:34.564297 25199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:34.565251 25190 server_base.cc:1034] running on GCE node
I20260811 12:45:34.566071 25190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:34.567603 25190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:34.568826 25190 hybrid_clock.cc:648] HybridClock initialized: now 1786452334568787 us; error 31 us; skew 500 ppm
I20260811 12:45:34.569223 25190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:34 dist-test-slave-qg60 krb5kdc[25176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452334, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:34.572522 25190 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:34.574201 25190 webserver.cc:460] Webserver started at http://127.0.0.1:45927/ using document root <none> and password file <none>
I20260811 12:45:34.574954 25190 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:34.575102 25190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:34.575444 25190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:34.578727 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "3b1b7c3e9b0645acb404994c8884358c"
format_stamp: "Formatted at 2026-08-11 12:45:34 on dist-test-slave-qg60"
server_key: "6fa965f5802dfe2afb8e9d263d56201b"
server_key_iv: "4238c76f972807da4008a132efa173fd"
server_key_version: "encryptionkey@0"
I20260811 12:45:34.579533 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "3b1b7c3e9b0645acb404994c8884358c"
format_stamp: "Formatted at 2026-08-11 12:45:34 on dist-test-slave-qg60"
server_key: "6fa965f5802dfe2afb8e9d263d56201b"
server_key_iv: "4238c76f972807da4008a132efa173fd"
server_key_version: "encryptionkey@0"
I20260811 12:45:34.585462 25190 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 12:45:34.590036 25207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:34.591542 25190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:34.591758 25190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "3b1b7c3e9b0645acb404994c8884358c"
format_stamp: "Formatted at 2026-08-11 12:45:34 on dist-test-slave-qg60"
server_key: "6fa965f5802dfe2afb8e9d263d56201b"
server_key_iv: "4238c76f972807da4008a132efa173fd"
server_key_version: "encryptionkey@0"
I20260811 12:45:34.591987 25190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:34.614006 25190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:34.619012 25190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:34.619374 25190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:34.640544 25190 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33755
I20260811 12:45:34.640589 25263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33755 every 8 connection(s)
I20260811 12:45:34.642150 25190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:34.645955 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25190
I20260811 12:45:34.646186 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:34.646835 745 external_mini_cluster.cc:1428] Setting key 45834fdfaa07d400d1a4b70c177c0a31
I20260811 12:45:34.646962 25264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:45:34 dist-test-slave-qg60 krb5kdc[25176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 12:45:34.664201 25264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c: Bootstrap starting.
I20260811 12:45:34.668548 25264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:34.670109 25264 log.cc:824] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:34.673918 25264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c: No bootstrap required, opened a new log
I20260811 12:45:34.674310 25267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:34.648987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:43239 (local address 127.0.0.1:33755)
0811 12:45:34.649835 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:34.649847 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:34.649897 (+ 50us) server_negotiation.cc:407] Connection header received
0811 12:45:34.652243 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:34.652268 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:34.652697 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:34.653127 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:34.655337 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:34.656825 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:34.658861 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:34.659634 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:34.659782 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:34.665607 (+ 5825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:34.665617 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:34.665634 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:34.665678 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:34.669174 (+ 3496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:34.670322 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:34.670333 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:34.670343 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:34.670533 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:34.671202 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:34.671209 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:34.671216 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:34.671930 (+ 714us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:34.672199 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:34.672812 (+ 613us) server_negotiation.cc:299] Negotiation successful
0811 12:45:34.673173 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":393,"threads_started":1}
I20260811 12:45:34.678544 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:34.685364 25264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1b7c3e9b0645acb404994c8884358c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33755 } }
I20260811 12:45:34.685997 25264 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:34.686127 25264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b1b7c3e9b0645acb404994c8884358c, State: Initialized, Role: FOLLOWER
I20260811 12:45:34.686811 25264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1b7c3e9b0645acb404994c8884358c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33755 } }
I20260811 12:45:34.687107 25264 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:34.687299 25264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:34.687500 25264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:34.690833 25264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1b7c3e9b0645acb404994c8884358c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33755 } }
I20260811 12:45:34.691569 25264 leader_election.cc:302] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b1b7c3e9b0645acb404994c8884358c; no voters:
I20260811 12:45:34.692423 25264 leader_election.cc:288] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:34.692570 25275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:34.694859 25264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:34.695799 25275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [term 1 LEADER]: Becoming Leader. State: Replica: 3b1b7c3e9b0645acb404994c8884358c, State: Running, Role: LEADER
I20260811 12:45:34.696559 25275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1b7c3e9b0645acb404994c8884358c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33755 } }
I20260811 12:45:34.701545 25277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b1b7c3e9b0645acb404994c8884358c. Latest consensus state: current_term: 1 leader_uuid: "3b1b7c3e9b0645acb404994c8884358c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1b7c3e9b0645acb404994c8884358c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33755 } } }
I20260811 12:45:34.702152 25277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:34.702867 25276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b1b7c3e9b0645acb404994c8884358c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1b7c3e9b0645acb404994c8884358c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33755 } } }
I20260811 12:45:34.703886 25276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:34.704011 25267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:34.684613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:45633 (local address 127.0.0.1:33755)
0811 12:45:34.684854 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:34.684861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:34.685426 (+ 565us) server_negotiation.cc:407] Connection header received
0811 12:45:34.685587 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:34.685592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:34.685689 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:34.685815 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:34.687825 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:34.689225 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:34.690585 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:34.691314 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:34.691461 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:34.695307 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:34.695314 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:34.695319 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:34.695370 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:34.699998 (+ 4628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:34.701085 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:34.701090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:34.701094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:34.701242 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:34.701762 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:34.701766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:34.701768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:34.702283 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:34.702870 (+ 587us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:34.703172 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 12:45:34.703376 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:45:34.707280 25280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:34.716183 25280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:34.732390 25280 catalog_manager.cc:1347] Generated new cluster ID: cf0bd5aeaebf439585cf08da3943c711
I20260811 12:45:34.732532 25280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:34.754215 25280 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:34.755589 25280 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:34.762897 25280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b1b7c3e9b0645acb404994c8884358c: Generated new TSK 0
I20260811 12:45:34.763808 25280 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:34.778932 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25190
I20260811 12:45:34.780349 25259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:34.876777 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25190
W20260811 12:45:34.900501 25174 connection.cc:535] client connection to 127.0.0.1:33755 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33755): Connection reset by peer (error 104)
2026-08-11T12:45:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2384 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:35 dist-test-slave-qg60 krb5kdc[25300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:35 dist-test-slave-qg60 krb5kdc[25300](info): set up 2 sockets
Aug 11 12:45:35 dist-test-slave-qg60 krb5kdc[25300](info): commencing operation
krb5kdc: starting...
W20260811 12:45:36.159330 745 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:36 dist-test-slave-qg60 krb5kdc[25300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:36.561656 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:36.937361 25314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:36.937680 25314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:36.937775 25314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:36.946801 25314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:36.946926 25314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:36.946974 25314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:36.947067 25314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:36.947111 25314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:36.957760 25314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:36.959177 25314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:36.960721 25314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:36.974277 25320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:36.974234 25322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:36.974843 25319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:36.975419 25314 server_base.cc:1034] running on GCE node
I20260811 12:45:36.976284 25314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:36.977901 25314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:36.979122 25314 hybrid_clock.cc:648] HybridClock initialized: now 1786452336979074 us; error 32 us; skew 500 ppm
I20260811 12:45:36.979508 25314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:36 dist-test-slave-qg60 krb5kdc[25300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452336, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:36.983032 25314 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:36.984901 25314 webserver.cc:460] Webserver started at http://127.0.0.1:32797/ using document root <none> and password file <none>
I20260811 12:45:36.985682 25314 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:36.985836 25314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:36.986186 25314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:36.989461 25314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "cd21c75f91994a449c1af3f33ab19cd8"
format_stamp: "Formatted at 2026-08-11 12:45:36 on dist-test-slave-qg60"
server_key: "62e4eac84b07eb0537ccdfa9d70a682c"
server_key_iv: "22f3e863a0810b0c3c9fa9a0bbe3d55a"
server_key_version: "encryptionkey@0"
I20260811 12:45:36.990310 25314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "cd21c75f91994a449c1af3f33ab19cd8"
format_stamp: "Formatted at 2026-08-11 12:45:36 on dist-test-slave-qg60"
server_key: "62e4eac84b07eb0537ccdfa9d70a682c"
server_key_iv: "22f3e863a0810b0c3c9fa9a0bbe3d55a"
server_key_version: "encryptionkey@0"
I20260811 12:45:36.996145 25314 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 12:45:37.000296 25330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:37.001995 25314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 12:45:37.002238 25314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "cd21c75f91994a449c1af3f33ab19cd8"
format_stamp: "Formatted at 2026-08-11 12:45:36 on dist-test-slave-qg60"
server_key: "62e4eac84b07eb0537ccdfa9d70a682c"
server_key_iv: "22f3e863a0810b0c3c9fa9a0bbe3d55a"
server_key_version: "encryptionkey@0"
I20260811 12:45:37.002463 25314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:37.022661 25314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:37.027817 25314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:37.028169 25314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:37.050439 25314 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34961
I20260811 12:45:37.050470 25385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34961 every 8 connection(s)
I20260811 12:45:37.051990 25314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:37.053301 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25314
I20260811 12:45:37.053504 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:37.053979 745 external_mini_cluster.cc:1428] Setting key 48cec0e2612dc12f1de6f583fd204206
I20260811 12:45:37.057297 25386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:37.071555 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:37.056068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:38341 (local address 127.0.0.1:34961)
0811 12:45:37.057021 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:37.057039 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:37.057100 (+ 61us) server_negotiation.cc:407] Connection header received
0811 12:45:37.059789 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:37.059820 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:37.060388 (+ 568us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:37.060990 (+ 602us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:37.061579 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:37.063919 (+ 2340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:37.065426 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:37.066625 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:37.066834 (+ 209us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:37.068166 (+ 1332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:37.068180 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:37.068203 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:37.069111 (+ 908us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:37.069232 (+ 121us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:37.069280 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:37.069478 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:37.069757 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 12:45:37.069980 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":385,"threads_started":1}
I20260811 12:45:37.073724 25386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8: Bootstrap starting.
I20260811 12:45:37.075887 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:37.077889 25386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:37.079373 25386 log.cc:824] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:37.083537 25386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8: No bootstrap required, opened a new log
I20260811 12:45:37.089955 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:37.082261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:34323 (local address 127.0.0.1:34961)
0811 12:45:37.082472 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:37.082478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:37.082851 (+ 373us) server_negotiation.cc:407] Connection header received
0811 12:45:37.083140 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:37.083147 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:37.083235 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:37.083362 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:37.083960 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:37.085305 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:37.086680 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:37.087520 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:37.087671 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:37.088934 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:37.088942 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:37.088947 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:37.088985 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:37.089040 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:37.089066 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:37.089212 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:37.089435 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 12:45:37.089514 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:45:37.093973 25386 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd21c75f91994a449c1af3f33ab19cd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34961 } }
I20260811 12:45:37.094455 25386 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:37.094599 25386 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd21c75f91994a449c1af3f33ab19cd8, State: Initialized, Role: FOLLOWER
I20260811 12:45:37.095270 25386 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd21c75f91994a449c1af3f33ab19cd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34961 } }
I20260811 12:45:37.095544 25386 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:37.095726 25386 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:37.095918 25386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:37.099000 25386 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd21c75f91994a449c1af3f33ab19cd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34961 } }
I20260811 12:45:37.099643 25386 leader_election.cc:302] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd21c75f91994a449c1af3f33ab19cd8; no voters:
I20260811 12:45:37.100311 25386 leader_election.cc:288] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:37.100492 25396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:37.101378 25396 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [term 1 LEADER]: Becoming Leader. State: Replica: cd21c75f91994a449c1af3f33ab19cd8, State: Running, Role: LEADER
I20260811 12:45:37.102101 25396 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd21c75f91994a449c1af3f33ab19cd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34961 } }
I20260811 12:45:37.103067 25386 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:37.105901 25398 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd21c75f91994a449c1af3f33ab19cd8. Latest consensus state: current_term: 1 leader_uuid: "cd21c75f91994a449c1af3f33ab19cd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd21c75f91994a449c1af3f33ab19cd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34961 } } }
I20260811 12:45:37.105880 25397 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd21c75f91994a449c1af3f33ab19cd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd21c75f91994a449c1af3f33ab19cd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34961 } } }
I20260811 12:45:37.106523 25397 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:37.106539 25398 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:37.110124 25405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:37.114518 25405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:37.125106 25405 catalog_manager.cc:1347] Generated new cluster ID: f13cf2d9f80f4a2b865b166379eb3b3c
I20260811 12:45:37.125269 25405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:37.141629 25405 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:37.142974 25405 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:37.151638 25405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd21c75f91994a449c1af3f33ab19cd8: Generated new TSK 0
I20260811 12:45:37.152523 25405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:37.162931 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25314
W20260811 12:45:37.164798 25381 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:38341
W20260811 12:45:37.171247 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25314: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:37.171505 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25314
W20260811 12:45:37.195468 25298 connection.cc:535] client connection to 127.0.0.1:34961 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34961): Connection reset by peer (error 104)
2026-08-11T12:45:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:37 dist-test-slave-qg60 krb5kdc[25418](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:37 dist-test-slave-qg60 krb5kdc[25418](info): set up 2 sockets
Aug 11 12:45:37 dist-test-slave-qg60 krb5kdc[25418](info): commencing operation
krb5kdc: starting...
W20260811 12:45:38.435218 745 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.007s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:38 dist-test-slave-qg60 krb5kdc[25418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:38.836161 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:39.220436 25433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:39.220788 25433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:39.220896 25433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:39.229225 25433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:39.229353 25433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:39.229400 25433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:39.229463 25433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:39.229508 25433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:39.240089 25433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:39.241482 25433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:39.242822 25433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:39.255611 25438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:39.255728 25442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:39.255693 25439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:39.256521 25433 server_base.cc:1034] running on GCE node
I20260811 12:45:39.257428 25433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:39.258924 25433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:39.260146 25433 hybrid_clock.cc:648] HybridClock initialized: now 1786452339260110 us; error 32 us; skew 500 ppm
I20260811 12:45:39.260573 25433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:39 dist-test-slave-qg60 krb5kdc[25418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452339, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:39.270221 25433 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:39.271963 25433 webserver.cc:460] Webserver started at http://127.0.0.1:42385/ using document root <none> and password file <none>
I20260811 12:45:39.272693 25433 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:39.272881 25433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:39.273185 25433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:39.276440 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "abc66b8e122c43c494a1a3f5bffe41ad"
format_stamp: "Formatted at 2026-08-11 12:45:39 on dist-test-slave-qg60"
server_key: "94cced34ab556a59bcfea9488ed71033"
server_key_iv: "fbc8cae39e22673b2f01c3c39dba03eb"
server_key_version: "encryptionkey@0"
I20260811 12:45:39.277300 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "abc66b8e122c43c494a1a3f5bffe41ad"
format_stamp: "Formatted at 2026-08-11 12:45:39 on dist-test-slave-qg60"
server_key: "94cced34ab556a59bcfea9488ed71033"
server_key_iv: "fbc8cae39e22673b2f01c3c39dba03eb"
server_key_version: "encryptionkey@0"
I20260811 12:45:39.282724 25433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:39.286437 25450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:39.287864 25433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 12:45:39.288072 25433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "abc66b8e122c43c494a1a3f5bffe41ad"
format_stamp: "Formatted at 2026-08-11 12:45:39 on dist-test-slave-qg60"
server_key: "94cced34ab556a59bcfea9488ed71033"
server_key_iv: "fbc8cae39e22673b2f01c3c39dba03eb"
server_key_version: "encryptionkey@0"
I20260811 12:45:39.288296 25433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:39.294471 25433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:39.299530 25433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:39.299877 25433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:39.320708 25433 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40469
I20260811 12:45:39.320802 25505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40469 every 8 connection(s)
I20260811 12:45:39.322280 25433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:39.325977 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25433
I20260811 12:45:39.326185 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:39.326195 25506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:39.326633 745 external_mini_cluster.cc:1428] Setting key bee6c71e817f407396d48362a4fd3a19
I20260811 12:45:39.335597 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:39.328514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:45169 (local address 127.0.0.1:40469)
0811 12:45:39.329517 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:39.329532 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:39.329588 (+ 56us) server_negotiation.cc:407] Connection header received
0811 12:45:39.331493 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:39.331522 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:39.331971 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:39.332444 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:39.333548 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:39.333556 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:39.333577 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:39.333596 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:39.333666 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:39.333702 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:39.333927 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:39.334070 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 12:45:39.334298 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":416,"threads_started":1}
I20260811 12:45:39.339538 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:39.341670 25506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad: Bootstrap starting.
I20260811 12:45:39.345136 25506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:39.346330 25506 log.cc:824] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:39.347160 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:39.344256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:47597 (local address 127.0.0.1:40469)
0811 12:45:39.344494 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:39.344503 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:39.345108 (+ 605us) server_negotiation.cc:407] Connection header received
0811 12:45:39.345245 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:39.345250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:39.345316 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:39.345432 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:39.346370 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:39.346375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:39.346380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:39.346398 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:39.346449 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:39.346470 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:39.346599 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:39.346720 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 12:45:39.346782 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 12:45:39.349567 25506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad: No bootstrap required, opened a new log
I20260811 12:45:39.357496 25506 raft_consensus.cc:348] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 12:45:39.357924 25506 raft_consensus.cc:374] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:39.358027 25506 raft_consensus.cc:729] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abc66b8e122c43c494a1a3f5bffe41ad, State: Initialized, Role: FOLLOWER
I20260811 12:45:39.358693 25506 consensus_queue.cc:260] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 12:45:39.358928 25506 raft_consensus.cc:388] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:39.359090 25506 raft_consensus.cc:482] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:39.359257 25506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:39.361721 25506 raft_consensus.cc:504] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 12:45:39.362355 25506 leader_election.cc:302] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abc66b8e122c43c494a1a3f5bffe41ad; no voters:
I20260811 12:45:39.363042 25506 leader_election.cc:288] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:39.363227 25518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:39.364068 25518 raft_consensus.cc:686] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [term 1 LEADER]: Becoming Leader. State: Replica: abc66b8e122c43c494a1a3f5bffe41ad, State: Running, Role: LEADER
I20260811 12:45:39.364682 25518 consensus_queue.cc:237] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 12:45:39.365449 25506 sys_catalog.cc:564] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:39.367969 25519 sys_catalog.cc:455] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } } }
I20260811 12:45:39.368424 25519 sys_catalog.cc:458] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:39.368603 25520 sys_catalog.cc:455] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader abc66b8e122c43c494a1a3f5bffe41ad. Latest consensus state: current_term: 1 leader_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc66b8e122c43c494a1a3f5bffe41ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } } }
I20260811 12:45:39.368989 25520 sys_catalog.cc:458] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:39.371223 25527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:39.375732 25527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:39.384646 25527 catalog_manager.cc:1347] Generated new cluster ID: 8c6cc8fa64bd45d894fe10810cc6d030
I20260811 12:45:39.384837 25527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:39.415014 25527 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:39.415566 25527 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:39.425556 25527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abc66b8e122c43c494a1a3f5bffe41ad: Generated new TSK 0
I20260811 12:45:39.426517 25527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:39.435626 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25433
W20260811 12:45:39.436828 25501 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:45169
W20260811 12:45:39.437594 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25433: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:39.437759 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25433
2026-08-11T12:45:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2265 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:39 dist-test-slave-qg60 krb5kdc[25539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:39 dist-test-slave-qg60 krb5kdc[25539](info): set up 2 sockets
Aug 11 12:45:39 dist-test-slave-qg60 krb5kdc[25539](info): commencing operation
krb5kdc: starting...
W20260811 12:45:40.686585 745 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.005s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:40 dist-test-slave-qg60 krb5kdc[25539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:41.094060 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41621
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:41.462194 25554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:41.462517 25554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:41.462702 25554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:41.470373 25554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:41.470517 25554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:41.470661 25554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:41.470763 25554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:41.470839 25554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:41.481271 25554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41621
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:41.482654 25554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:41.484082 25554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:41.496398 25559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:41.496548 25560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:41.496548 25563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:41.497797 25554 server_base.cc:1034] running on GCE node
I20260811 12:45:41.498760 25554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:41.500301 25554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:41.501585 25554 hybrid_clock.cc:648] HybridClock initialized: now 1786452341501541 us; error 35 us; skew 500 ppm
I20260811 12:45:41.502066 25554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:41 dist-test-slave-qg60 krb5kdc[25539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452341, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:41.505722 25554 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:41.507541 25554 webserver.cc:460] Webserver started at http://127.0.0.1:38109/ using document root <none> and password file <none>
I20260811 12:45:41.508307 25554 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:41.508441 25554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:41.508796 25554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:41.512372 25554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "5f0f7fb8d0504fecb37b3d0c1330281e"
format_stamp: "Formatted at 2026-08-11 12:45:41 on dist-test-slave-qg60"
server_key: "8cbc31d3ee1850e701920802ef9af56c"
server_key_iv: "dff4daefb9fcb2f78919f09444df9797"
server_key_version: "encryptionkey@0"
I20260811 12:45:41.513602 25554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "5f0f7fb8d0504fecb37b3d0c1330281e"
format_stamp: "Formatted at 2026-08-11 12:45:41 on dist-test-slave-qg60"
server_key: "8cbc31d3ee1850e701920802ef9af56c"
server_key_iv: "dff4daefb9fcb2f78919f09444df9797"
server_key_version: "encryptionkey@0"
I20260811 12:45:41.519454 25554 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 12:45:41.523306 25570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:41.525141 25554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 12:45:41.525377 25554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "5f0f7fb8d0504fecb37b3d0c1330281e"
format_stamp: "Formatted at 2026-08-11 12:45:41 on dist-test-slave-qg60"
server_key: "8cbc31d3ee1850e701920802ef9af56c"
server_key_iv: "dff4daefb9fcb2f78919f09444df9797"
server_key_version: "encryptionkey@0"
I20260811 12:45:41.525615 25554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:41.560277 25554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:41.565241 25554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:41.565588 25554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:41.585407 25554 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41621
I20260811 12:45:41.585498 25625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41621 every 8 connection(s)
I20260811 12:45:41.586838 25554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:41.591071 25626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:41.594377 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25554
I20260811 12:45:41.594591 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:41.595043 745 external_mini_cluster.cc:1428] Setting key a6961bf9c4327acd2bb82228c5b0df46
I20260811 12:45:41.603705 25626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e: Bootstrap starting.
I20260811 12:45:41.607059 25626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:41.608131 25626 log.cc:824] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e: Log is configured to *not* fsync() on all Append() calls
Aug 11 12:45:41 dist-test-slave-qg60 krb5kdc[25539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 12:45:41.611788 25626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e: No bootstrap required, opened a new log
I20260811 12:45:41.621232 25629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:41.597113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:39109 (local address 127.0.0.1:41621)
0811 12:45:41.597954 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:41.597966 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:41.598009 (+ 43us) server_negotiation.cc:407] Connection header received
0811 12:45:41.599767 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:41.599789 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:41.600191 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:41.600617 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:41.602206 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:41.603492 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:41.604887 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:41.605578 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:41.605819 (+ 241us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:41.610605 (+ 4786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:41.610617 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:41.610636 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:41.610680 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:41.615199 (+ 4519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:41.616595 (+ 1396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:41.616605 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:41.616616 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:41.616876 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:41.617429 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:41.617435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:41.617439 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:41.618314 (+ 875us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:41.618670 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:41.619171 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 12:45:41.619586 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":392,"threads_started":1}
I20260811 12:45:41.623121 25626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41621 } }
I20260811 12:45:41.623634 25626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:41.623768 25626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0f7fb8d0504fecb37b3d0c1330281e, State: Initialized, Role: FOLLOWER
I20260811 12:45:41.624408 25626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41621 } }
I20260811 12:45:41.624709 25626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:41.624886 25626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:41.625078 25626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:41.626174 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:41.628388 25626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41621 } }
I20260811 12:45:41.629091 25626 leader_election.cc:302] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f0f7fb8d0504fecb37b3d0c1330281e; no voters:
I20260811 12:45:41.629835 25626 leader_election.cc:288] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:41.629904 25632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:41.632622 25626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:41.633145 25632 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [term 1 LEADER]: Becoming Leader. State: Replica: 5f0f7fb8d0504fecb37b3d0c1330281e, State: Running, Role: LEADER
I20260811 12:45:41.633777 25632 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41621 } }
I20260811 12:45:41.637019 25636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f0f7fb8d0504fecb37b3d0c1330281e. Latest consensus state: current_term: 1 leader_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41621 } } }
I20260811 12:45:41.637008 25634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f0f7fb8d0504fecb37b3d0c1330281e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41621 } } }
I20260811 12:45:41.637506 25634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:41.637506 25636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:41.653466 25641 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:41.661005 25641 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:41.685146 25641 catalog_manager.cc:1347] Generated new cluster ID: 4e1b6ece5f2349ec865741e91e4e5d4f
I20260811 12:45:41.685288 25641 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:41.689458 25629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:41.654681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:33017 (local address 127.0.0.1:41621)
0811 12:45:41.654930 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:41.654939 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:41.661740 (+ 6801us) server_negotiation.cc:407] Connection header received
0811 12:45:41.661991 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:41.661999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:41.662115 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:41.662257 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:41.664776 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:41.666493 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:41.669165 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:41.670259 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:41.670402 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:41.675198 (+ 4796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:41.675210 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:41.675219 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:41.675280 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:41.680282 (+ 5002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:41.681766 (+ 1484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:41.681775 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:41.681782 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:41.682013 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:41.682823 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:41.682831 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:41.682837 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:41.683420 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:41.683763 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:41.684689 (+ 926us) server_negotiation.cc:299] Negotiation successful
0811 12:45:41.684996 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:45:41.711496 25641 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:41.712957 25641 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:41.722360 25641 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f0f7fb8d0504fecb37b3d0c1330281e: Generated new TSK 0
I20260811 12:45:41.723238 25641 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:41.732007 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25554
I20260811 12:45:41.733623 25621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:41.828836 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25554
W20260811 12:45:41.851946 25537 connection.cc:535] client connection to 127.0.0.1:41621 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41621): Connection reset by peer (error 104)
2026-08-11T12:45:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2396 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:41 dist-test-slave-qg60 krb5kdc[25661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:41 dist-test-slave-qg60 krb5kdc[25661](info): set up 2 sockets
Aug 11 12:45:41 dist-test-slave-qg60 krb5kdc[25661](info): commencing operation
krb5kdc: starting...
W20260811 12:45:43.126883 745 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.001s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:43 dist-test-slave-qg60 krb5kdc[25661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:43.512946 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39401
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:43.877636 25674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:43.877991 25674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:43.878176 25674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:43.885519 25674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:43.885653 25674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:43.885742 25674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:43.885828 25674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:43.885910 25674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:43.896291 25674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39401
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:43.897775 25674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:43.899192 25674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:43.912058 25682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:43.912150 25679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:43.912084 25680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:43.913416 25674 server_base.cc:1034] running on GCE node
I20260811 12:45:43.914310 25674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:43.915876 25674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:43.917201 25674 hybrid_clock.cc:648] HybridClock initialized: now 1786452343917138 us; error 42 us; skew 500 ppm
I20260811 12:45:43.917620 25674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:43 dist-test-slave-qg60 krb5kdc[25661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452343, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:43.921187 25674 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:43.922830 25674 webserver.cc:460] Webserver started at http://127.0.0.1:40615/ using document root <none> and password file <none>
I20260811 12:45:43.923568 25674 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:43.923717 25674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:43.924031 25674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:43.927269 25674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "594bdb9b446b418c955c4682d52a8b97"
format_stamp: "Formatted at 2026-08-11 12:45:43 on dist-test-slave-qg60"
server_key: "9e64fcb65629fc84d38c7a79e64248ca"
server_key_iv: "19744f35695d144c99fb3f9e742927e4"
server_key_version: "encryptionkey@0"
I20260811 12:45:43.928103 25674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "594bdb9b446b418c955c4682d52a8b97"
format_stamp: "Formatted at 2026-08-11 12:45:43 on dist-test-slave-qg60"
server_key: "9e64fcb65629fc84d38c7a79e64248ca"
server_key_iv: "19744f35695d144c99fb3f9e742927e4"
server_key_version: "encryptionkey@0"
I20260811 12:45:43.933667 25674 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:45:43.937618 25689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:43.939141 25674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:43.939347 25674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "594bdb9b446b418c955c4682d52a8b97"
format_stamp: "Formatted at 2026-08-11 12:45:43 on dist-test-slave-qg60"
server_key: "9e64fcb65629fc84d38c7a79e64248ca"
server_key_iv: "19744f35695d144c99fb3f9e742927e4"
server_key_version: "encryptionkey@0"
I20260811 12:45:43.939581 25674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:43.973892 25674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:43.978344 25674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:43.978663 25674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:43.999003 25674 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39401
I20260811 12:45:43.999049 25747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39401 every 8 connection(s)
I20260811 12:45:44.000543 25674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:44.001015 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25674
I20260811 12:45:44.001230 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:44.001699 745 external_mini_cluster.cc:1428] Setting key b44ed69c7c03d6aef9a65053cc6862e0
I20260811 12:45:44.005838 25748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:44.016872 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:44.003878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:56301 (local address 127.0.0.1:39401)
0811 12:45:44.004829 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:44.004843 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:44.004889 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:45:44.006747 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:44.006772 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:44.007185 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:44.007595 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:44.008179 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:44.009961 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:44.011583 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:44.012363 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:44.012586 (+ 223us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:44.014100 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:44.014109 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:44.014125 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:44.014781 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:44.014874 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:44.014911 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:44.015143 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:44.015483 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 12:45:44.015676 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":365,"threads_started":1}
I20260811 12:45:44.017657 25748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97: Bootstrap starting.
I20260811 12:45:44.021643 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:44.021808 25748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:44.022897 25748 log.cc:824] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:44.026055 25748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97: No bootstrap required, opened a new log
I20260811 12:45:44.034543 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:44.026982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:41243 (local address 127.0.0.1:39401)
0811 12:45:44.027186 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:44.027193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:44.027720 (+ 527us) server_negotiation.cc:407] Connection header received
0811 12:45:44.027887 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:44.027895 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:44.027999 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:44.028126 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:44.028670 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:44.029919 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:44.031447 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:44.032182 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:44.032341 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:44.033613 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:44.033624 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:44.033629 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:44.033654 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:44.033711 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:44.033738 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:44.033867 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:44.034195 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 12:45:44.034257 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:45:44.036479 25748 raft_consensus.cc:348] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594bdb9b446b418c955c4682d52a8b97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260811 12:45:44.036976 25748 raft_consensus.cc:374] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:44.037093 25748 raft_consensus.cc:729] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 594bdb9b446b418c955c4682d52a8b97, State: Initialized, Role: FOLLOWER
I20260811 12:45:44.037747 25748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594bdb9b446b418c955c4682d52a8b97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260811 12:45:44.038010 25748 raft_consensus.cc:388] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:44.038166 25748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:44.038364 25748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:44.041226 25748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594bdb9b446b418c955c4682d52a8b97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260811 12:45:44.041782 25748 leader_election.cc:302] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 594bdb9b446b418c955c4682d52a8b97; no voters:
I20260811 12:45:44.042398 25748 leader_election.cc:288] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:44.042550 25758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:44.043344 25758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [term 1 LEADER]: Becoming Leader. State: Replica: 594bdb9b446b418c955c4682d52a8b97, State: Running, Role: LEADER
I20260811 12:45:44.043984 25758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594bdb9b446b418c955c4682d52a8b97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260811 12:45:44.044816 25748 sys_catalog.cc:564] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:44.046685 25759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "594bdb9b446b418c955c4682d52a8b97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594bdb9b446b418c955c4682d52a8b97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } } }
I20260811 12:45:44.047140 25759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:44.047724 25760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 594bdb9b446b418c955c4682d52a8b97. Latest consensus state: current_term: 1 leader_uuid: "594bdb9b446b418c955c4682d52a8b97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594bdb9b446b418c955c4682d52a8b97" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } } }
I20260811 12:45:44.048072 25760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:44.050244 25763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:44.061035 25763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:44.070887 25763 catalog_manager.cc:1347] Generated new cluster ID: 9f870a12865b434ebd4f1db9e0fa210e
I20260811 12:45:44.071029 25763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:44.092824 25763 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:44.094412 25763 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:44.110977 25763 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 594bdb9b446b418c955c4682d52a8b97: Generated new TSK 0
I20260811 12:45:44.111889 25763 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:44.125705 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25674
W20260811 12:45:44.127696 25743 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:56301
W20260811 12:45:44.128526 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25674: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:44.128710 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25674
W20260811 12:45:44.151675 25659 connection.cc:535] client connection to 127.0.0.1:39401 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39401): Connection reset by peer (error 104)
2026-08-11T12:45:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:44 dist-test-slave-qg60 krb5kdc[25779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:44 dist-test-slave-qg60 krb5kdc[25779](info): set up 2 sockets
Aug 11 12:45:44 dist-test-slave-qg60 krb5kdc[25779](info): commencing operation
krb5kdc: starting...
W20260811 12:45:45.411453 745 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.004s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:45 dist-test-slave-qg60 krb5kdc[25779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 12:45:45.809167 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35563
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:46.188210 25797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:46.188529 25797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:46.188625 25797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:46.196837 25797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:46.196985 25797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:46.197036 25797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:46.197101 25797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:46.197147 25797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:46.207818 25797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35563
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:46.209268 25797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:46.210628 25797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:46.223407 25805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:46.223462 25803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:46.223346 25802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:46.224572 25797 server_base.cc:1034] running on GCE node
I20260811 12:45:46.225551 25797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:46.227098 25797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:46.228346 25797 hybrid_clock.cc:648] HybridClock initialized: now 1786452346228299 us; error 42 us; skew 500 ppm
I20260811 12:45:46.228796 25797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:46 dist-test-slave-qg60 krb5kdc[25779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452346, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:46.232087 25797 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 12:45:46.233824 25797 webserver.cc:460] Webserver started at http://127.0.0.1:43777/ using document root <none> and password file <none>
I20260811 12:45:46.234582 25797 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:46.234738 25797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:46.235070 25797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:46.238309 25797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "bdcf879aa8b54a668284ef61572dc230"
format_stamp: "Formatted at 2026-08-11 12:45:46 on dist-test-slave-qg60"
server_key: "8a02525164acd396cf7f502093197650"
server_key_iv: "27acc3bcdce71e73aa8bcb1d2338ecb3"
server_key_version: "encryptionkey@0"
I20260811 12:45:46.239125 25797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "bdcf879aa8b54a668284ef61572dc230"
format_stamp: "Formatted at 2026-08-11 12:45:46 on dist-test-slave-qg60"
server_key: "8a02525164acd396cf7f502093197650"
server_key_iv: "27acc3bcdce71e73aa8bcb1d2338ecb3"
server_key_version: "encryptionkey@0"
I20260811 12:45:46.244969 25797 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 12:45:46.249287 25814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:46.250813 25797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:45:46.251039 25797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "bdcf879aa8b54a668284ef61572dc230"
format_stamp: "Formatted at 2026-08-11 12:45:46 on dist-test-slave-qg60"
server_key: "8a02525164acd396cf7f502093197650"
server_key_iv: "27acc3bcdce71e73aa8bcb1d2338ecb3"
server_key_version: "encryptionkey@0"
I20260811 12:45:46.251267 25797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:46.257789 25797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:46.262305 25797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:46.262646 25797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:46.282601 25797 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35563
I20260811 12:45:46.282655 25871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35563 every 8 connection(s)
I20260811 12:45:46.284078 25797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:46.288033 25872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:46.289618 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25797
I20260811 12:45:46.289835 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:46.290411 745 external_mini_cluster.cc:1428] Setting key a028787b4e86f9bce5557a0ab9335c7a
I20260811 12:45:46.298651 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:46.292392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:39877 (local address 127.0.0.1:35563)
0811 12:45:46.293314 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:46.293326 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:46.293375 (+ 49us) server_negotiation.cc:407] Connection header received
0811 12:45:46.295026 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:46.295054 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:46.295413 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:46.295782 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:46.297007 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:46.297014 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:46.297026 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:46.297042 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:46.297107 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:46.297130 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:46.297297 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:46.297445 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 12:45:46.297718 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":442,"threads_started":1}
I20260811 12:45:46.303079 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:46.303180 25872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230: Bootstrap starting.
I20260811 12:45:46.306463 25872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:46.307838 25872 log.cc:824] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:46.310355 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:46.307683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:47947 (local address 127.0.0.1:35563)
0811 12:45:46.307894 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:46.307902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:46.308315 (+ 413us) server_negotiation.cc:407] Connection header received
0811 12:45:46.308510 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:46.308517 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:46.308572 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:46.308699 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:46.309676 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:46.309681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:46.309686 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:46.309705 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:46.309751 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:46.309766 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:46.309884 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:46.310017 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 12:45:46.310085 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 12:45:46.311034 25872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230: No bootstrap required, opened a new log
I20260811 12:45:46.319386 25872 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcf879aa8b54a668284ef61572dc230" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35563 } }
I20260811 12:45:46.319845 25872 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:46.319967 25872 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdcf879aa8b54a668284ef61572dc230, State: Initialized, Role: FOLLOWER
I20260811 12:45:46.320561 25872 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcf879aa8b54a668284ef61572dc230" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35563 } }
I20260811 12:45:46.320830 25872 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:46.321007 25872 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:46.321209 25872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:46.323446 25872 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcf879aa8b54a668284ef61572dc230" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35563 } }
I20260811 12:45:46.323956 25872 leader_election.cc:302] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdcf879aa8b54a668284ef61572dc230; no voters:
I20260811 12:45:46.324589 25872 leader_election.cc:288] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:46.324765 25883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:46.326525 25883 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [term 1 LEADER]: Becoming Leader. State: Replica: bdcf879aa8b54a668284ef61572dc230, State: Running, Role: LEADER
I20260811 12:45:46.327209 25883 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcf879aa8b54a668284ef61572dc230" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35563 } }
I20260811 12:45:46.327827 25872 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:46.330583 25884 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdcf879aa8b54a668284ef61572dc230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcf879aa8b54a668284ef61572dc230" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35563 } } }
I20260811 12:45:46.331100 25884 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:46.330665 25885 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdcf879aa8b54a668284ef61572dc230. Latest consensus state: current_term: 1 leader_uuid: "bdcf879aa8b54a668284ef61572dc230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcf879aa8b54a668284ef61572dc230" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35563 } } }
I20260811 12:45:46.333077 25885 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:46.337517 25891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:46.342300 25891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:46.351040 25891 catalog_manager.cc:1347] Generated new cluster ID: b4d05d813e5b4ac7aabc7471ce664de7
I20260811 12:45:46.351222 25891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:46.380029 25891 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:46.380517 25891 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:46.387774 25891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdcf879aa8b54a668284ef61572dc230: Generated new TSK 0
I20260811 12:45:46.388622 25891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:46.401468 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25797
W20260811 12:45:46.402648 25867 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:39877
W20260811 12:45:46.403369 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25797: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:46.403533 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25797
2026-08-11T12:45:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2274 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:46 dist-test-slave-qg60 krb5kdc[25907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:46 dist-test-slave-qg60 krb5kdc[25907](info): set up 2 sockets
Aug 11 12:45:46 dist-test-slave-qg60 krb5kdc[25907](info): commencing operation
krb5kdc: starting...
W20260811 12:45:47.652180 745 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:47 dist-test-slave-qg60 krb5kdc[25907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:48.046500 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42365
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:42365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:48.413491 25923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:48.413812 25923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:48.413924 25923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:48.421826 25923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:48.421993 25923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:48.422044 25923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:48.422101 25923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:48.422148 25923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:48.432597 25923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:42365
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:42365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:48.434098 25923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:48.435446 25923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:48.448576 25932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:48.448660 25929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:48.448689 25930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:48.450073 25923 server_base.cc:1034] running on GCE node
I20260811 12:45:48.451025 25923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:48.452586 25923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:48.453840 25923 hybrid_clock.cc:648] HybridClock initialized: now 1786452348453782 us; error 64 us; skew 500 ppm
I20260811 12:45:48.454258 25923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:48 dist-test-slave-qg60 krb5kdc[25907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452348, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:48.457653 25923 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:48.459197 25923 webserver.cc:460] Webserver started at http://127.0.186.126:36277/ using document root <none> and password file <none>
I20260811 12:45:48.459885 25923 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:48.459988 25923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:48.460264 25923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:48.463613 25923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "6b93b9a6542145398dfd12300cd521fa"
format_stamp: "Formatted at 2026-08-11 12:45:48 on dist-test-slave-qg60"
server_key: "9fcc859831b968d0345b253b3303b3de"
server_key_iv: "6b2f34bfd1b0e1247b5dbf544ae05cd7"
server_key_version: "encryptionkey@0"
I20260811 12:45:48.464447 25923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "6b93b9a6542145398dfd12300cd521fa"
format_stamp: "Formatted at 2026-08-11 12:45:48 on dist-test-slave-qg60"
server_key: "9fcc859831b968d0345b253b3303b3de"
server_key_iv: "6b2f34bfd1b0e1247b5dbf544ae05cd7"
server_key_version: "encryptionkey@0"
I20260811 12:45:48.470284 25923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 12:45:48.474423 25941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:48.476073 25923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260811 12:45:48.476238 25923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "6b93b9a6542145398dfd12300cd521fa"
format_stamp: "Formatted at 2026-08-11 12:45:48 on dist-test-slave-qg60"
server_key: "9fcc859831b968d0345b253b3303b3de"
server_key_iv: "6b2f34bfd1b0e1247b5dbf544ae05cd7"
server_key_version: "encryptionkey@0"
I20260811 12:45:48.476433 25923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:48.490029 25923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:48.494715 25923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:48.494985 25923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:48.515482 25923 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:42365
I20260811 12:45:48.515506 25992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:42365 every 8 connection(s)
I20260811 12:45:48.517143 25923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:48.521207 25993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:48.525319 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 25923
I20260811 12:45:48.525539 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:48.526087 745 external_mini_cluster.cc:1428] Setting key b5e6afb21b9342fa1e710f11192999f4
I20260811 12:45:48.535022 25993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa: Bootstrap starting.
I20260811 12:45:48.539589 25993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:48.541157 25993 log.cc:824] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa: Log is configured to *not* fsync() on all Append() calls
Aug 11 12:45:48 dist-test-slave-qg60 krb5kdc[25907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:48.544896 25993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa: No bootstrap required, opened a new log
I20260811 12:45:48.554023 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:48.528080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38683 (local address 127.0.186.126:42365)
0811 12:45:48.529014 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:48.529025 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:48.529068 (+ 43us) server_negotiation.cc:407] Connection header received
0811 12:45:48.530746 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:48.530770 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:48.531219 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:48.531548 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:48.533464 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:48.534859 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:48.536896 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:48.537705 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:48.537876 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:48.543811 (+ 5935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:48.543819 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:48.543840 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:48.543879 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:48.548471 (+ 4592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:48.549615 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:48.549625 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:48.549635 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:48.549860 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:48.550402 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:48.550417 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:48.550421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:48.551234 (+ 813us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:48.551616 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:48.552047 (+ 431us) server_negotiation.cc:299] Negotiation successful
0811 12:45:48.552472 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":430,"threads_started":1}
I20260811 12:45:48.556682 25993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b93b9a6542145398dfd12300cd521fa" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42365 } }
I20260811 12:45:48.557246 25993 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:48.557353 25993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b93b9a6542145398dfd12300cd521fa, State: Initialized, Role: FOLLOWER
I20260811 12:45:48.558116 25993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b93b9a6542145398dfd12300cd521fa" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42365 } }
I20260811 12:45:48.558403 25993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:48.558578 25993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:48.558768 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:48.558792 25993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:48.561197 25993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b93b9a6542145398dfd12300cd521fa" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42365 } }
I20260811 12:45:48.561825 25993 leader_election.cc:302] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b93b9a6542145398dfd12300cd521fa; no voters:
I20260811 12:45:48.562659 25993 leader_election.cc:288] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:48.562826 26004 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:48.565199 25993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:48.565299 26004 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [term 1 LEADER]: Becoming Leader. State: Replica: 6b93b9a6542145398dfd12300cd521fa, State: Running, Role: LEADER
I20260811 12:45:48.566032 26004 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b93b9a6542145398dfd12300cd521fa" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42365 } }
I20260811 12:45:48.569676 26006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b93b9a6542145398dfd12300cd521fa. Latest consensus state: current_term: 1 leader_uuid: "6b93b9a6542145398dfd12300cd521fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b93b9a6542145398dfd12300cd521fa" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42365 } } }
I20260811 12:45:48.570151 26006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:48.570077 26005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b93b9a6542145398dfd12300cd521fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b93b9a6542145398dfd12300cd521fa" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 42365 } } }
I20260811 12:45:48.570387 26005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:48.572683 26016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:48.583534 26016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:48.587603 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:48.564294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42685 (local address 127.0.186.126:42365)
0811 12:45:48.564499 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:48.564506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:48.565289 (+ 783us) server_negotiation.cc:407] Connection header received
0811 12:45:48.565638 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:48.565643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:48.565734 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:48.565853 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:48.568228 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:48.569658 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:48.572115 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:48.574034 (+ 1919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:48.574186 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:48.578664 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:48.578670 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:48.578676 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:48.578718 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:48.582865 (+ 4147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:48.584024 (+ 1159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:48.584029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:48.584034 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:48.584196 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:48.584901 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:48.584906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:48.584909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:48.585338 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:48.585614 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:48.587014 (+ 1400us) server_negotiation.cc:299] Negotiation successful
0811 12:45:48.587219 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:45:48.599726 26016 catalog_manager.cc:1347] Generated new cluster ID: 173815938ad240998c807d41e6c43561
I20260811 12:45:48.599867 26016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:48.620893 26016 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:48.622359 26016 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:48.632786 26016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b93b9a6542145398dfd12300cd521fa: Generated new TSK 0
I20260811 12:45:48.633682 26016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:48.642516 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 25923
I20260811 12:45:48.643661 25988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:48.738622 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 25923
W20260811 12:45:48.763878 25905 connection.cc:535] client connection to 127.0.186.126:42365 recv error: Network error: failed to read from TLS socket (remote: 127.0.186.126:42365): Connection reset by peer (error 104)
2026-08-11T12:45:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2336 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:48 dist-test-slave-qg60 krb5kdc[26031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:48 dist-test-slave-qg60 krb5kdc[26031](info): set up 2 sockets
Aug 11 12:45:48 dist-test-slave-qg60 krb5kdc[26031](info): commencing operation
krb5kdc: starting...
W20260811 12:45:49.985800 745 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:50 dist-test-slave-qg60 krb5kdc[26031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:50.378618 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39667
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:41747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:50.759779 26045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:50.760154 26045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:50.760313 26045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:50.768005 26045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:50.768162 26045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:50.768268 26045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:50.768373 26045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:50.768450 26045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:50.779326 26045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:41747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39667
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:50.780793 26045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:50.782210 26045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:50.794912 26050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:50.794945 26056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:50.794862 26053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:50.796259 26045 server_base.cc:1034] running on GCE node
I20260811 12:45:50.797235 26045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:50.798828 26045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:50.800153 26045 hybrid_clock.cc:648] HybridClock initialized: now 1786452350800108 us; error 30 us; skew 500 ppm
I20260811 12:45:50.800549 26045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:50 dist-test-slave-qg60 krb5kdc[26031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:50.809355 26045 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:50.811159 26045 webserver.cc:460] Webserver started at http://127.0.186.126:37899/ using document root <none> and password file <none>
I20260811 12:45:50.811929 26045 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:50.812101 26045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:50.812435 26045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:50.815711 26045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "377724483a7b4964a2ddc14c5030892f"
format_stamp: "Formatted at 2026-08-11 12:45:50 on dist-test-slave-qg60"
server_key: "596492d9806f11a85d8f002bae17c394"
server_key_iv: "77b2e75ae99755ba8ccfaaea3d89a539"
server_key_version: "encryptionkey@0"
I20260811 12:45:50.816571 26045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "377724483a7b4964a2ddc14c5030892f"
format_stamp: "Formatted at 2026-08-11 12:45:50 on dist-test-slave-qg60"
server_key: "596492d9806f11a85d8f002bae17c394"
server_key_iv: "77b2e75ae99755ba8ccfaaea3d89a539"
server_key_version: "encryptionkey@0"
I20260811 12:45:50.822664 26045 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 12:45:50.826370 26063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:50.827768 26045 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:45:50.827968 26045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "377724483a7b4964a2ddc14c5030892f"
format_stamp: "Formatted at 2026-08-11 12:45:50 on dist-test-slave-qg60"
server_key: "596492d9806f11a85d8f002bae17c394"
server_key_iv: "77b2e75ae99755ba8ccfaaea3d89a539"
server_key_version: "encryptionkey@0"
I20260811 12:45:50.828226 26045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:50.856235 26045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:50.861250 26045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:50.861580 26045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:50.882709 26045 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39667
I20260811 12:45:50.882733 26116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39667 every 8 connection(s)
I20260811 12:45:50.884135 26045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:50.888350 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26045
I20260811 12:45:50.888579 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:50.888566 26117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:50.889261 745 external_mini_cluster.cc:1428] Setting key 734eb8f3aa453b8277a52a01843de9be
I20260811 12:45:50.903808 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:50.891199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37451 (local address 127.0.186.126:39667)
0811 12:45:50.892135 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:50.892148 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:50.892195 (+ 47us) server_negotiation.cc:407] Connection header received
0811 12:45:50.893955 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:50.893980 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:50.894439 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:50.894793 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:50.895462 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:50.896948 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:50.898824 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:50.899530 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:50.899662 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:50.901182 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:50.901190 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:50.901206 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:50.901864 (+ 658us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:50.901959 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:50.902001 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:50.902140 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:50.902538 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 12:45:50.902765 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":446,"threads_started":1}
I20260811 12:45:50.903867 26117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f: Bootstrap starting.
I20260811 12:45:50.907433 26117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:50.908130 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:50.908763 26117 log.cc:824] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:50.912454 26117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f: No bootstrap required, opened a new log
I20260811 12:45:50.920838 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:50.913513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58627 (local address 127.0.186.126:39667)
0811 12:45:50.913714 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:50.913721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:50.914170 (+ 449us) server_negotiation.cc:407] Connection header received
0811 12:45:50.914334 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:50.914340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:50.914431 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:50.914549 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:50.915104 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:50.916315 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:50.917762 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:50.918547 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:50.918684 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:50.919932 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:50.919938 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:50.919943 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:50.919968 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:50.920019 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:50.920049 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:50.920161 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:50.920359 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 12:45:50.920431 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:45:50.922747 26117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377724483a7b4964a2ddc14c5030892f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39667 } }
I20260811 12:45:50.923141 26117 raft_consensus.cc:374] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:50.923221 26117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377724483a7b4964a2ddc14c5030892f, State: Initialized, Role: FOLLOWER
I20260811 12:45:50.923763 26117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377724483a7b4964a2ddc14c5030892f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39667 } }
I20260811 12:45:50.923990 26117 raft_consensus.cc:388] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:50.924103 26117 raft_consensus.cc:482] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:50.924253 26117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:50.926614 26117 raft_consensus.cc:504] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377724483a7b4964a2ddc14c5030892f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39667 } }
I20260811 12:45:50.927162 26117 leader_election.cc:302] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 377724483a7b4964a2ddc14c5030892f; no voters:
I20260811 12:45:50.927776 26117 leader_election.cc:288] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:50.927920 26128 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:50.928665 26128 raft_consensus.cc:686] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [term 1 LEADER]: Becoming Leader. State: Replica: 377724483a7b4964a2ddc14c5030892f, State: Running, Role: LEADER
I20260811 12:45:50.929268 26128 consensus_queue.cc:237] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377724483a7b4964a2ddc14c5030892f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39667 } }
I20260811 12:45:50.930096 26117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:50.931982 26129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "377724483a7b4964a2ddc14c5030892f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377724483a7b4964a2ddc14c5030892f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39667 } } }
I20260811 12:45:50.932428 26129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:50.933236 26130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 377724483a7b4964a2ddc14c5030892f. Latest consensus state: current_term: 1 leader_uuid: "377724483a7b4964a2ddc14c5030892f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377724483a7b4964a2ddc14c5030892f" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39667 } } }
I20260811 12:45:50.937506 26130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:50.938191 26133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:50.944201 26133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:50.954346 26133 catalog_manager.cc:1347] Generated new cluster ID: 3a764a11873e4e32af0afd5ae40b5a9b
I20260811 12:45:50.954493 26133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:50.971107 26133 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:50.972640 26133 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:50.986001 26133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 377724483a7b4964a2ddc14c5030892f: Generated new TSK 0
I20260811 12:45:50.986968 26133 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:50.995563 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26045
W20260811 12:45:50.997905 26112 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37451
W20260811 12:45:50.998703 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26045: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:50.998880 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26045
W20260811 12:45:51.022373 26029 connection.cc:535] client connection to 127.0.186.126:39667 recv error: Network error: failed to read from TLS socket (remote: 127.0.186.126:39667): Connection reset by peer (error 104)
2026-08-11T12:45:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2258 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:51 dist-test-slave-qg60 krb5kdc[26150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:51 dist-test-slave-qg60 krb5kdc[26150](info): set up 2 sockets
Aug 11 12:45:51 dist-test-slave-qg60 krb5kdc[26150](info): commencing operation
krb5kdc: starting...
W20260811 12:45:52.261490 745 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:52 dist-test-slave-qg60 krb5kdc[26150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:52.644891 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:32965
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:42377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:32965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:53.013520 26165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:53.013903 26165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:53.014073 26165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:53.021724 26165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:53.021888 26165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:53.022009 26165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:53.022119 26165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:53.022197 26165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:53.033036 26165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:42377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:32965
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:32965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:53.034525 26165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:53.035962 26165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:53.048585 26171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:53.048683 26172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:53.048645 26174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:53.049806 26165 server_base.cc:1034] running on GCE node
I20260811 12:45:53.050755 26165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:53.052482 26165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:53.053768 26165 hybrid_clock.cc:648] HybridClock initialized: now 1786452353053694 us; error 55 us; skew 500 ppm
I20260811 12:45:53.054207 26165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:53 dist-test-slave-qg60 krb5kdc[26150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452353, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:53.057854 26165 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:53.059791 26165 webserver.cc:460] Webserver started at http://127.0.186.126:35643/ using document root <none> and password file <none>
I20260811 12:45:53.060642 26165 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:53.060853 26165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:53.061223 26165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:53.064965 26165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "44216b3472e744feab9007575d53cbf4"
format_stamp: "Formatted at 2026-08-11 12:45:53 on dist-test-slave-qg60"
server_key: "4e3d51f14fd4bae1cb39e7758fdf0eb4"
server_key_iv: "76ea1a1da549107893431371e39697ca"
server_key_version: "encryptionkey@0"
I20260811 12:45:53.065963 26165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "44216b3472e744feab9007575d53cbf4"
format_stamp: "Formatted at 2026-08-11 12:45:53 on dist-test-slave-qg60"
server_key: "4e3d51f14fd4bae1cb39e7758fdf0eb4"
server_key_iv: "76ea1a1da549107893431371e39697ca"
server_key_version: "encryptionkey@0"
I20260811 12:45:53.072249 26165 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 12:45:53.076277 26181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:53.077785 26165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:53.078001 26165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "44216b3472e744feab9007575d53cbf4"
format_stamp: "Formatted at 2026-08-11 12:45:53 on dist-test-slave-qg60"
server_key: "4e3d51f14fd4bae1cb39e7758fdf0eb4"
server_key_iv: "76ea1a1da549107893431371e39697ca"
server_key_version: "encryptionkey@0"
I20260811 12:45:53.078240 26165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:53.084769 26165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:53.089406 26165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:53.089767 26165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:53.111728 26165 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:32965
I20260811 12:45:53.111774 26237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:32965 every 8 connection(s)
I20260811 12:45:53.113389 26165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:53.117578 26238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:53.123297 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26165
I20260811 12:45:53.123510 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:53.124049 745 external_mini_cluster.cc:1428] Setting key 64177bdb65fe90cbe113cd5fa5f5249e
I20260811 12:45:53.130317 26238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4: Bootstrap starting.
I20260811 12:45:53.132983 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:53.126130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42095 (local address 127.0.186.126:32965)
0811 12:45:53.127051 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:53.127064 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:53.127112 (+ 48us) server_negotiation.cc:407] Connection header received
0811 12:45:53.129135 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:53.129160 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:53.129531 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:53.129891 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:53.131109 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:53.131117 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:53.131135 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:53.131155 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:53.131221 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:53.131242 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:53.131421 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:53.131610 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 12:45:53.131867 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":440,"threads_started":1}
I20260811 12:45:53.134500 26238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:53.135799 26238 log.cc:824] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:53.137444 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:53.139155 26238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4: No bootstrap required, opened a new log
I20260811 12:45:53.145051 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:53.142153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37875 (local address 127.0.186.126:32965)
0811 12:45:53.142358 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:53.142365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:53.142928 (+ 563us) server_negotiation.cc:407] Connection header received
0811 12:45:53.143085 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:53.143090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:53.143154 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:53.143267 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:53.144283 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:53.144288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:53.144293 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:53.144314 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:53.144366 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:53.144386 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:53.144522 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:53.144624 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 12:45:53.144695 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:45:53.148434 26238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44216b3472e744feab9007575d53cbf4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32965 } }
I20260811 12:45:53.149127 26238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:53.149246 26238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44216b3472e744feab9007575d53cbf4, State: Initialized, Role: FOLLOWER
I20260811 12:45:53.150007 26238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44216b3472e744feab9007575d53cbf4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32965 } }
I20260811 12:45:53.150276 26238 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:53.150463 26238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:53.150664 26238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:53.153152 26238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44216b3472e744feab9007575d53cbf4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32965 } }
I20260811 12:45:53.153733 26238 leader_election.cc:302] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44216b3472e744feab9007575d53cbf4; no voters:
I20260811 12:45:53.154466 26238 leader_election.cc:288] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:53.154707 26248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:53.156283 26248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [term 1 LEADER]: Becoming Leader. State: Replica: 44216b3472e744feab9007575d53cbf4, State: Running, Role: LEADER
I20260811 12:45:53.156900 26238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:53.156958 26248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44216b3472e744feab9007575d53cbf4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32965 } }
I20260811 12:45:53.161140 26249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44216b3472e744feab9007575d53cbf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44216b3472e744feab9007575d53cbf4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32965 } } }
I20260811 12:45:53.161762 26249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:53.161187 26250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44216b3472e744feab9007575d53cbf4. Latest consensus state: current_term: 1 leader_uuid: "44216b3472e744feab9007575d53cbf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44216b3472e744feab9007575d53cbf4" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 32965 } } }
I20260811 12:45:53.162796 26250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:53.166126 26259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:53.170575 26259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:53.179993 26259 catalog_manager.cc:1347] Generated new cluster ID: 711cd1d4406a4a2084501a66fd5b6057
I20260811 12:45:53.180145 26259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:53.225768 26259 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:53.226363 26259 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:53.234259 26259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44216b3472e744feab9007575d53cbf4: Generated new TSK 0
I20260811 12:45:53.235412 26259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:53.254465 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26165
W20260811 12:45:53.255714 26232 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42095
W20260811 12:45:53.256582 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26165: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:53.256781 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26165
2026-08-11T12:45:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2258 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:53 dist-test-slave-qg60 krb5kdc[26270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:53 dist-test-slave-qg60 krb5kdc[26270](info): set up 2 sockets
Aug 11 12:45:53 dist-test-slave-qg60 krb5kdc[26270](info): commencing operation
krb5kdc: starting...
W20260811 12:45:54.501801 745 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.002s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:54 dist-test-slave-qg60 krb5kdc[26270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:54.897413 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:37131
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:46427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:37131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:55.266431 26284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:55.266745 26284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:55.266940 26284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:55.274402 26284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:55.274552 26284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:55.274654 26284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:55.274760 26284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:55.274838 26284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:55.285233 26284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:46427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:37131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:37131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:55.286670 26284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:55.288085 26284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:55.300231 26289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:55.300295 26290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:55.300431 26292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:55.301460 26284 server_base.cc:1034] running on GCE node
I20260811 12:45:55.302222 26284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:55.303597 26284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:55.304852 26284 hybrid_clock.cc:648] HybridClock initialized: now 1786452355304794 us; error 44 us; skew 500 ppm
I20260811 12:45:55.305192 26284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:55 dist-test-slave-qg60 krb5kdc[26270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:55.314345 26284 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:55.316046 26284 webserver.cc:460] Webserver started at http://127.0.186.126:43323/ using document root <none> and password file <none>
I20260811 12:45:55.316887 26284 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:55.317054 26284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:55.317418 26284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:55.320577 26284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "932ceacaa73746a2a7a3b5ceacc21e5a"
format_stamp: "Formatted at 2026-08-11 12:45:55 on dist-test-slave-qg60"
server_key: "665293082565f95d4bf7f0aa33952718"
server_key_iv: "2a3894f53349b5aa9fb3d554f10767a9"
server_key_version: "encryptionkey@0"
I20260811 12:45:55.321519 26284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "932ceacaa73746a2a7a3b5ceacc21e5a"
format_stamp: "Formatted at 2026-08-11 12:45:55 on dist-test-slave-qg60"
server_key: "665293082565f95d4bf7f0aa33952718"
server_key_iv: "2a3894f53349b5aa9fb3d554f10767a9"
server_key_version: "encryptionkey@0"
I20260811 12:45:55.327214 26284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:55.331391 26300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:55.332953 26284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 12:45:55.333174 26284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "932ceacaa73746a2a7a3b5ceacc21e5a"
format_stamp: "Formatted at 2026-08-11 12:45:55 on dist-test-slave-qg60"
server_key: "665293082565f95d4bf7f0aa33952718"
server_key_iv: "2a3894f53349b5aa9fb3d554f10767a9"
server_key_version: "encryptionkey@0"
I20260811 12:45:55.333395 26284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:55.346596 26284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:55.351131 26284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:55.351459 26284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:55.371742 26284 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:37131
I20260811 12:45:55.371834 26359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:37131 every 8 connection(s)
I20260811 12:45:55.373332 26284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:55.375775 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26284
I20260811 12:45:55.375974 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:55.376565 745 external_mini_cluster.cc:1428] Setting key 4c78b9220f4fd37761ddda8019bf0d32
I20260811 12:45:55.377856 26360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 12:45:55 dist-test-slave-qg60 krb5kdc[26270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:45:55.392518 26360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a: Bootstrap starting.
I20260811 12:45:55.396991 26360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:55.398284 26360 log.cc:824] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:55.402024 26360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a: No bootstrap required, opened a new log
I20260811 12:45:55.402328 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:55.378458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39553 (local address 127.0.186.126:37131)
0811 12:45:55.379284 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:55.379300 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:55.379352 (+ 52us) server_negotiation.cc:407] Connection header received
0811 12:45:55.381482 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:55.381510 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:55.382048 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:55.382485 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:55.384315 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:55.386438 (+ 2123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:55.387720 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:55.388827 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:55.389045 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:55.393399 (+ 4354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:55.393411 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:55.393437 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:55.393482 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:55.397681 (+ 4199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:55.398405 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:55.398414 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:55.398422 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:55.398655 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:55.399151 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:55.399154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:55.399157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:55.399734 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:55.400047 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:55.400523 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 12:45:55.401000 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":347,"threads_started":1}
I20260811 12:45:55.406086 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:55.410597 26360 raft_consensus.cc:348] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 37131 } }
I20260811 12:45:55.411103 26360 raft_consensus.cc:374] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:55.411230 26360 raft_consensus.cc:729] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932ceacaa73746a2a7a3b5ceacc21e5a, State: Initialized, Role: FOLLOWER
I20260811 12:45:55.411876 26360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 37131 } }
I20260811 12:45:55.412199 26360 raft_consensus.cc:388] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:55.412360 26360 raft_consensus.cc:482] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:55.412540 26360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:55.414892 26360 raft_consensus.cc:504] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 37131 } }
I20260811 12:45:55.415409 26360 leader_election.cc:302] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 932ceacaa73746a2a7a3b5ceacc21e5a; no voters:
I20260811 12:45:55.416121 26360 leader_election.cc:288] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:55.416275 26370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:55.418891 26360 sys_catalog.cc:564] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:55.423141 26370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [term 1 LEADER]: Becoming Leader. State: Replica: 932ceacaa73746a2a7a3b5ceacc21e5a, State: Running, Role: LEADER
I20260811 12:45:55.423956 26370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 37131 } }
I20260811 12:45:55.425719 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:55.410475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52707 (local address 127.0.186.126:37131)
0811 12:45:55.410645 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:55.410649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:55.411261 (+ 612us) server_negotiation.cc:407] Connection header received
0811 12:45:55.411463 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:55.411468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:55.411545 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:55.411658 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:55.413367 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:55.414166 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:55.415495 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:55.416084 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:55.416234 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:55.418991 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:55.418997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:55.419004 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:45:55.419047 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:55.422057 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:55.422983 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:55.422992 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:55.422995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:55.423203 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:45:55.423775 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:45:55.423780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:45:55.423785 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:45:55.424309 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:55.424533 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:55.425131 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 12:45:55.425352 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:45:55.429055 26371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 37131 } } }
I20260811 12:45:55.429128 26372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 932ceacaa73746a2a7a3b5ceacc21e5a. Latest consensus state: current_term: 1 leader_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "932ceacaa73746a2a7a3b5ceacc21e5a" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 37131 } } }
I20260811 12:45:55.429484 26371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:55.429528 26372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:55.431826 26383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:55.437383 26383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:55.447889 26383 catalog_manager.cc:1347] Generated new cluster ID: e85eaadb00374d0f9fd1a70bb483cf4b
I20260811 12:45:55.448073 26383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:55.459235 26383 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:55.461222 26383 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:55.476161 26383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 932ceacaa73746a2a7a3b5ceacc21e5a: Generated new TSK 0
I20260811 12:45:55.477173 26383 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:55.490516 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26284
I20260811 12:45:55.491667 26355 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:45:55.604993 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26284
2026-08-11T12:45:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2346 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:55 dist-test-slave-qg60 krb5kdc[26394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:55 dist-test-slave-qg60 krb5kdc[26394](info): set up 2 sockets
Aug 11 12:45:55 dist-test-slave-qg60 krb5kdc[26394](info): commencing operation
krb5kdc: starting...
W20260811 12:45:56.884871 745 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.009s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:57 dist-test-slave-qg60 krb5kdc[26394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:57.280084 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45033
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:45033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:57.649866 26407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:57.650277 26407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:57.650452 26407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:57.658469 26407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:57.658636 26407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:57.658742 26407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:57.658852 26407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:57.658938 26407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:57.669757 26407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:45033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:45033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:57.671218 26407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:57.672631 26407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:57.685266 26413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:57.685189 26417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:57.685225 26414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:57.686667 26407 server_base.cc:1034] running on GCE node
I20260811 12:45:57.687583 26407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:57.689248 26407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:57.690510 26407 hybrid_clock.cc:648] HybridClock initialized: now 1786452357690468 us; error 76 us; skew 500 ppm
I20260811 12:45:57.690888 26407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:57 dist-test-slave-qg60 krb5kdc[26394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:57.699788 26407 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:57.701628 26407 webserver.cc:460] Webserver started at http://127.0.186.126:44057/ using document root <none> and password file <none>
I20260811 12:45:57.702369 26407 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:57.702481 26407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:57.702765 26407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:57.706034 26407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "3bd2e3ee09334e58adb9ee36a94bcee5"
format_stamp: "Formatted at 2026-08-11 12:45:57 on dist-test-slave-qg60"
server_key: "6e4b234206d700b5189153ce44c0a11d"
server_key_iv: "028586b936b548662f389e976a816797"
server_key_version: "encryptionkey@0"
I20260811 12:45:57.706915 26407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "3bd2e3ee09334e58adb9ee36a94bcee5"
format_stamp: "Formatted at 2026-08-11 12:45:57 on dist-test-slave-qg60"
server_key: "6e4b234206d700b5189153ce44c0a11d"
server_key_iv: "028586b936b548662f389e976a816797"
server_key_version: "encryptionkey@0"
I20260811 12:45:57.713351 26407 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 12:45:57.717211 26425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:57.718747 26407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 12:45:57.718953 26407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "3bd2e3ee09334e58adb9ee36a94bcee5"
format_stamp: "Formatted at 2026-08-11 12:45:57 on dist-test-slave-qg60"
server_key: "6e4b234206d700b5189153ce44c0a11d"
server_key_iv: "028586b936b548662f389e976a816797"
server_key_version: "encryptionkey@0"
I20260811 12:45:57.719226 26407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:57.743780 26407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:57.748605 26407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:57.748983 26407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:57.769655 26407 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:45033
I20260811 12:45:57.769690 26480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:45033 every 8 connection(s)
I20260811 12:45:57.771266 26407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:57.775362 26481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:57.779596 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26407
I20260811 12:45:57.779806 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:57.780402 745 external_mini_cluster.cc:1428] Setting key 446109682cfd2a9f32bb79e46eea8b37
I20260811 12:45:57.789474 26481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5: Bootstrap starting.
I20260811 12:45:57.793582 26481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5: Neither blocks nor log segments found. Creating new log.
I20260811 12:45:57.794799 26481 log.cc:824] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5: Log is configured to *not* fsync() on all Append() calls
I20260811 12:45:57.794865 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:57.782523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58917 (local address 127.0.186.126:45033)
0811 12:45:57.783395 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:57.783406 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:57.783452 (+ 46us) server_negotiation.cc:407] Connection header received
0811 12:45:57.785200 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:57.785225 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:57.785675 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:57.786030 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:57.786717 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:57.788217 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:57.790161 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:57.790834 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:57.791055 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:57.792306 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:57.792313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:57.792327 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:57.792996 (+ 669us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:57.793077 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:57.793103 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:57.793203 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:57.793469 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 12:45:57.793819 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":444,"threads_started":1}
I20260811 12:45:57.798390 26481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5: No bootstrap required, opened a new log
I20260811 12:45:57.799161 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:57.809231 26481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45033 } }
I20260811 12:45:57.809803 26481 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:45:57.809937 26481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd2e3ee09334e58adb9ee36a94bcee5, State: Initialized, Role: FOLLOWER
I20260811 12:45:57.810700 26481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45033 } }
I20260811 12:45:57.811041 26481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:45:57.811214 26481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:45:57.811468 26481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:45:57.811937 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:57.804876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54527 (local address 127.0.186.126:45033)
0811 12:45:57.805088 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:57.805095 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:57.805536 (+ 441us) server_negotiation.cc:407] Connection header received
0811 12:45:57.805702 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:57.805707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:57.805794 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:57.805915 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:57.806464 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:57.807609 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:57.808964 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:45:57.809615 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:45:57.809758 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:45:57.811014 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:57.811021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:57.811031 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:57.811058 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:57.811136 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:57.811160 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:57.811275 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:57.811483 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 12:45:57.811593 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 12:45:57.814486 26481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45033 } }
I20260811 12:45:57.815033 26481 leader_election.cc:302] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bd2e3ee09334e58adb9ee36a94bcee5; no voters:
I20260811 12:45:57.815687 26481 leader_election.cc:288] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:45:57.815783 26493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:45:57.816573 26493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd2e3ee09334e58adb9ee36a94bcee5, State: Running, Role: LEADER
I20260811 12:45:57.817216 26493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45033 } }
I20260811 12:45:57.818068 26481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:45:57.820221 26495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bd2e3ee09334e58adb9ee36a94bcee5. Latest consensus state: current_term: 1 leader_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45033 } } }
I20260811 12:45:57.820595 26495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:57.820931 26494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd2e3ee09334e58adb9ee36a94bcee5" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 45033 } } }
I20260811 12:45:57.821369 26494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5 [sys.catalog]: This master's current role is: LEADER
I20260811 12:45:57.830272 26500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:45:57.835970 26500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:45:57.846273 26500 catalog_manager.cc:1347] Generated new cluster ID: 986a53088aaa4dbc88098aea18b1200a
I20260811 12:45:57.846589 26500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:45:57.862093 26500 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:45:57.864122 26500 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:45:57.872042 26500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bd2e3ee09334e58adb9ee36a94bcee5: Generated new TSK 0
I20260811 12:45:57.873276 26500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:45:57.883112 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26407
W20260811 12:45:57.884311 26476 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58917
W20260811 12:45:57.885121 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26407: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:45:57.885293 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26407
2026-08-11T12:45:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2280 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:45:58 dist-test-slave-qg60 krb5kdc[26516](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:45:58 dist-test-slave-qg60 krb5kdc[26516](info): set up 2 sockets
Aug 11 12:45:58 dist-test-slave-qg60 krb5kdc[26516](info): commencing operation
krb5kdc: starting...
W20260811 12:45:59.130232 745 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:45:59 dist-test-slave-qg60 krb5kdc[26516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:45:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:45:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:45:59.524782 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35429
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:35429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:45:59.882961 26530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:45:59.883276 26530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:45:59.883467 26530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:45:59.891381 26530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:45:59.891562 26530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:45:59.891688 26530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:45:59.891803 26530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:45:59.891888 26530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:45:59.902484 26530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:35429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:35429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:45:59.903954 26530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:45:59.905469 26530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:45:59.918449 26540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:59.918488 26538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:45:59.918402 26536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:45:59.919354 26530 server_base.cc:1034] running on GCE node
I20260811 12:45:59.920235 26530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:45:59.921816 26530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:45:59.923074 26530 hybrid_clock.cc:648] HybridClock initialized: now 1786452359923017 us; error 45 us; skew 500 ppm
I20260811 12:45:59.923453 26530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:45:59 dist-test-slave-qg60 krb5kdc[26516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452359, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:45:59.926787 26530 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:45:59.928344 26530 webserver.cc:460] Webserver started at http://127.0.186.126:40845/ using document root <none> and password file <none>
I20260811 12:45:59.929133 26530 fs_manager.cc:359] Metadata directory not provided
I20260811 12:45:59.929251 26530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:45:59.929519 26530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:45:59.932709 26530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "bc9674c114404e729839632a3435a52e"
format_stamp: "Formatted at 2026-08-11 12:45:59 on dist-test-slave-qg60"
server_key: "a5a4f3ba639e7b09ce829be5ed0d979f"
server_key_iv: "e09ab163d610c5019cfbcbd875e302c6"
server_key_version: "encryptionkey@0"
I20260811 12:45:59.933540 26530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "bc9674c114404e729839632a3435a52e"
format_stamp: "Formatted at 2026-08-11 12:45:59 on dist-test-slave-qg60"
server_key: "a5a4f3ba639e7b09ce829be5ed0d979f"
server_key_iv: "e09ab163d610c5019cfbcbd875e302c6"
server_key_version: "encryptionkey@0"
I20260811 12:45:59.938997 26530 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:45:59.942792 26547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:45:59.944234 26530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:45:59.944424 26530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "bc9674c114404e729839632a3435a52e"
format_stamp: "Formatted at 2026-08-11 12:45:59 on dist-test-slave-qg60"
server_key: "a5a4f3ba639e7b09ce829be5ed0d979f"
server_key_iv: "e09ab163d610c5019cfbcbd875e302c6"
server_key_version: "encryptionkey@0"
I20260811 12:45:59.944638 26530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:45:59.950758 26530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:45:59.955207 26530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:45:59.955529 26530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:45:59.975632 26530 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:35429
I20260811 12:45:59.975730 26603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:35429 every 8 connection(s)
I20260811 12:45:59.977247 26530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:45:59.981292 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:45:59.983174 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26530
I20260811 12:45:59.983376 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:45:59.983830 745 external_mini_cluster.cc:1428] Setting key 8f8ed99049b45123e4a8b1cfc727bdb5
I20260811 12:45:59.992748 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:45:59.985876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46945 (local address 127.0.186.126:35429)
0811 12:45:59.986793 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0811 12:45:59.986808 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:45:59.986868 (+ 60us) server_negotiation.cc:407] Connection header received
0811 12:45:59.988669 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:45:59.988706 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:45:59.989220 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:45:59.989713 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:45:59.990722 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:45:59.990731 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:45:59.990747 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:45:59.990765 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:45:59.990838 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:45:59.990865 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:45:59.991095 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 12:45:59.991229 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 12:45:59.991429 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":414,"threads_started":1}
I20260811 12:45:59.996325 26604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e: Bootstrap starting.
I20260811 12:45:59.996524 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:45:59.999559 26604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:00.001303 26604 log.cc:824] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:00.005227 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:00.002458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57443 (local address 127.0.186.126:35429)
0811 12:46:00.002683 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:00.002690 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:00.003062 (+ 372us) server_negotiation.cc:407] Connection header received
0811 12:46:00.003213 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:00.003218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:00.003283 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:00.003407 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:00.004424 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:00.004430 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:00.004434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 12:46:00.004457 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:00.004510 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 12:46:00.004530 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:00.004684 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:00.004851 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 12:46:00.004918 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:46:00.005246 26604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e: No bootstrap required, opened a new log
I20260811 12:46:00.013875 26604 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc9674c114404e729839632a3435a52e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35429 } }
I20260811 12:46:00.014367 26604 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:46:00.014501 26604 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9674c114404e729839632a3435a52e, State: Initialized, Role: FOLLOWER
I20260811 12:46:00.015166 26604 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc9674c114404e729839632a3435a52e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35429 } }
I20260811 12:46:00.015424 26604 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:46:00.015594 26604 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:46:00.015767 26604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:46:00.018198 26604 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc9674c114404e729839632a3435a52e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35429 } }
I20260811 12:46:00.018790 26604 leader_election.cc:302] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc9674c114404e729839632a3435a52e; no voters:
I20260811 12:46:00.019424 26604 leader_election.cc:288] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 12:46:00.019625 26614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:46:00.020310 26614 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [term 1 LEADER]: Becoming Leader. State: Replica: bc9674c114404e729839632a3435a52e, State: Running, Role: LEADER
I20260811 12:46:00.020928 26614 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc9674c114404e729839632a3435a52e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35429 } }
I20260811 12:46:00.021720 26604 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:46:00.023840 26615 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc9674c114404e729839632a3435a52e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc9674c114404e729839632a3435a52e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35429 } } }
I20260811 12:46:00.024250 26615 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:00.025504 26616 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc9674c114404e729839632a3435a52e. Latest consensus state: current_term: 1 leader_uuid: "bc9674c114404e729839632a3435a52e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc9674c114404e729839632a3435a52e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 35429 } } }
I20260811 12:46:00.025962 26616 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:00.027280 26619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:46:00.032981 26619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:46:00.049088 26632 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 12:46:00.052850 26619 catalog_manager.cc:1347] Generated new cluster ID: b76148788a4446f9842eb4c019e1746d
I20260811 12:46:00.052983 26619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:46:00.089699 26619 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:46:00.090240 26619 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:46:00.101009 26619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc9674c114404e729839632a3435a52e: Generated new TSK 0
I20260811 12:46:00.102077 26619 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:46:00.116988 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26530
W20260811 12:46:00.118232 26599 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46945
W20260811 12:46:00.119021 745 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26530: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 12:46:00.119182 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26530
2026-08-11T12:46:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2234 ms)
[----------] 18 tests from AuthTokenIssuingTest (41589 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:46:00 dist-test-slave-qg60 krb5kdc[26636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:46:00 dist-test-slave-qg60 krb5kdc[26636](info): set up 2 sockets
Aug 11 12:46:00 dist-test-slave-qg60 krb5kdc[26636](info): commencing operation
krb5kdc: starting...
W20260811 12:46:01.384464 745 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:46:01 dist-test-slave-qg60 krb5kdc[26636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:46:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:46:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:46:01.789105 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39113
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39113,127.0.186.125:33823,127.0.186.124:35799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:46:02.153182 26651 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 12:46:02.153582 26651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:46:02.153735 26651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:46:02.153872 26651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:46:02.161403 26651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:46:02.161505 26651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:46:02.161566 26651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:46:02.161674 26651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:46:02.161792 26651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:46:02.172050 26651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39113,127.0.186.125:33823,127.0.186.124:35799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:46:02.173530 26651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:46:02.174937 26651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:46:02.187609 26656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:02.187572 26657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:02.187659 26659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:46:02.188479 26651 server_base.cc:1034] running on GCE node
I20260811 12:46:02.189376 26651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:46:02.190900 26651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:46:02.192142 26651 hybrid_clock.cc:648] HybridClock initialized: now 1786452362192077 us; error 30 us; skew 500 ppm
I20260811 12:46:02.192493 26651 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:46:02 dist-test-slave-qg60 krb5kdc[26636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:46:02.196020 26651 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:46:02.197819 26651 webserver.cc:460] Webserver started at http://127.0.186.126:46585/ using document root <none> and password file <none>
I20260811 12:46:02.198576 26651 fs_manager.cc:359] Metadata directory not provided
I20260811 12:46:02.198699 26651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:46:02.199067 26651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:46:02.202348 26651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "0f16420c03864bc186a377d21122a6a7"
format_stamp: "Formatted at 2026-08-11 12:46:02 on dist-test-slave-qg60"
server_key: "5249d5facf6bd3470ec7b2d5bb18184b"
server_key_iv: "8ba7a31eb8bdc3ae554fa7214273b50d"
server_key_version: "encryptionkey@0"
I20260811 12:46:02.203197 26651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "0f16420c03864bc186a377d21122a6a7"
format_stamp: "Formatted at 2026-08-11 12:46:02 on dist-test-slave-qg60"
server_key: "5249d5facf6bd3470ec7b2d5bb18184b"
server_key_iv: "8ba7a31eb8bdc3ae554fa7214273b50d"
server_key_version: "encryptionkey@0"
I20260811 12:46:02.208797 26651 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:46:02.212360 26669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:46:02.213833 26651 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 12:46:02.214031 26651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "0f16420c03864bc186a377d21122a6a7"
format_stamp: "Formatted at 2026-08-11 12:46:02 on dist-test-slave-qg60"
server_key: "5249d5facf6bd3470ec7b2d5bb18184b"
server_key_iv: "8ba7a31eb8bdc3ae554fa7214273b50d"
server_key_version: "encryptionkey@0"
I20260811 12:46:02.214273 26651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:46:02.248646 26651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:46:02.253067 26651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:46:02.253371 26651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:46:02.273981 26651 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39113
I20260811 12:46:02.274082 26724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39113 every 8 connection(s)
I20260811 12:46:02.275419 26651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:46:02.279362 26725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:46:02.279470 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26651
I20260811 12:46:02.279702 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:46:02.280570 745 external_mini_cluster.cc:1428] Setting key 7863ffd0e541f96d24ed98ff91323261
I20260811 12:46:02.289914 26725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:02 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:46:02.316769 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.294074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39113 (local address 127.0.0.1:42848)
0811 12:46:02.295067 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.295115 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:02.297062 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:02.298128 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:02.298133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:02.298713 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:02.299077 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.299095 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.300939 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.300948 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.302933 (+ 1985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.302952 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.304007 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.304020 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.304247 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.305082 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:02.305116 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:02.308101 (+ 2985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:02.312013 (+ 3912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.312027 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.312048 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.312470 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:02.312973 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.312980 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.312983 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.313146 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:02.313982 (+ 836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:02.313991 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:02.314241 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 12:46:02.314521 (+ 280us) client_negotiation.cc:240] Negotiation successful
0811 12:46:02.315262 (+ 741us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"mutex_wait_us":236,"thread_start_us":449,"threads_started":1}
I20260811 12:46:02.316805 26728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.294074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42848 (local address 127.0.186.126:39113)
0811 12:46:02.295165 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:02.295176 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:02.295234 (+ 58us) server_negotiation.cc:407] Connection header received
0811 12:46:02.297471 (+ 2237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:02.297481 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:02.297809 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:02.298056 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:02.299325 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.300680 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.303113 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.303697 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.303850 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.308372 (+ 4522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:02.308381 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:02.308400 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:02.308432 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:02.311821 (+ 3389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:02.312617 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:02.312629 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:02.312637 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:02.312859 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:02.313256 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:02.313263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:02.313266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:02.313826 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:02.314034 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:02.314631 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 12:46:02.315136 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":760,"spinlock_wait_cycles":35200,"thread_start_us":495,"threads_started":1}
I20260811 12:46:02.320426 26725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.0.186.125@KRBTEST.COM; defaulting to no policy
I20260811 12:46:02.321717 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.321273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40632)
0811 12:46:02.321467 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.321578 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260811 12:46:02.322182 26671 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.125@KRBTEST.COM" created.
I20260811 12:46:02.323911 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.323484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40644)
0811 12:46:02.323675 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.323765 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 12:46:02.324221 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:33823: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab.
Entry for principal kudu/127.0.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab.
I20260811 12:46:02.368546 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:33823
--webserver_interface=127.0.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab
--principal=kudu/127.0.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39113,127.0.186.125:33823,127.0.186.124:35799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:46:02.373623 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } attempt: 1
I20260811 12:46:02.374852 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.374361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40646)
0811 12:46:02.374575 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.374713 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 12:46:02.376012 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.375658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40652)
0811 12:46:02.375812 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.375879 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 12:46:02.376232 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:33823: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
I20260811 12:46:02.444540 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } attempt: 2
I20260811 12:46:02.445969 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.445395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40666)
0811 12:46:02.445710 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.445810 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260811 12:46:02.447180 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.446737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40670)
0811 12:46:02.446912 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.447051 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 12:46:02.447386 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:33823: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
I20260811 12:46:02.538686 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } attempt: 3
I20260811 12:46:02.539942 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.539483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40678)
0811 12:46:02.539708 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.539804 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 12:46:02.541222 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.540788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40684)
0811 12:46:02.540947 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.541073 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 12:46:02.541455 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:33823: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
I20260811 12:46:02.684844 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } attempt: 4
I20260811 12:46:02.686406 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.685723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40690)
0811 12:46:02.686170 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.686262 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261}
I20260811 12:46:02.687592 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.687185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40692)
0811 12:46:02.687348 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.687430 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 12:46:02.687790 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:33823: Network error: Client connection negotiation failed: client connection to 127.0.186.125:33823: connect: Connection refused (error 111)
W20260811 12:46:02.739389 26733 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 12:46:02.739840 26733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:46:02.739991 26733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:46:02.740144 26733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:46:02.753084 26733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:46:02.753227 26733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:46:02.753351 26733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:46:02.753453 26733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:46:02.753556 26733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:46:02.765285 26733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39113,127.0.186.125:33823,127.0.186.124:35799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab
--principal=kudu/127.0.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:33823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:46:02.766741 26733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:46:02.768193 26733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:46:02.781466 26739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:02.781492 26743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:02.781553 26740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:46:02.782452 26733 server_base.cc:1034] running on GCE node
I20260811 12:46:02.783362 26733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:46:02.784932 26733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:46:02.786259 26733 hybrid_clock.cc:648] HybridClock initialized: now 1786452362786172 us; error 52 us; skew 500 ppm
I20260811 12:46:02.786741 26733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:46:02 dist-test-slave-qg60 krb5kdc[26636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:46:02.796962 26733 init.cc:377] Logged in from keytab as kudu/127.0.186.125@KRBTEST.COM (short username kudu)
I20260811 12:46:02.798751 26733 webserver.cc:460] Webserver started at http://127.0.186.125:42519/ using document root <none> and password file <none>
I20260811 12:46:02.799602 26733 fs_manager.cc:359] Metadata directory not provided
I20260811 12:46:02.799743 26733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:46:02.800091 26733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:46:02.803390 26733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data/instance:
uuid: "4929f26d8f0c425f99c85b255bcf4af7"
format_stamp: "Formatted at 2026-08-11 12:46:02 on dist-test-slave-qg60"
server_key: "c263cf89acb0630e24944b0e6c606c7b"
server_key_iv: "7abd80bec627a766088fad1b0ec1327e"
server_key_version: "encryptionkey@0"
I20260811 12:46:02.804260 26733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal/instance:
uuid: "4929f26d8f0c425f99c85b255bcf4af7"
format_stamp: "Formatted at 2026-08-11 12:46:02 on dist-test-slave-qg60"
server_key: "c263cf89acb0630e24944b0e6c606c7b"
server_key_iv: "7abd80bec627a766088fad1b0ec1327e"
server_key_version: "encryptionkey@0"
I20260811 12:46:02.810000 26733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 12:46:02.813799 26751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:46:02.815174 26733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:46:02.815364 26733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal
uuid: "4929f26d8f0c425f99c85b255bcf4af7"
format_stamp: "Formatted at 2026-08-11 12:46:02 on dist-test-slave-qg60"
server_key: "c263cf89acb0630e24944b0e6c606c7b"
server_key_iv: "7abd80bec627a766088fad1b0ec1327e"
server_key_version: "encryptionkey@0"
I20260811 12:46:02.815613 26733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:46:02.840874 26733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:46:02.845510 26733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:46:02.845832 26733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:46:02.866217 26733 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.125:33823
I20260811 12:46:02.866238 26806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.125:33823 every 8 connection(s)
I20260811 12:46:02.867707 26733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
I20260811 12:46:02.868482 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26733
I20260811 12:46:02.868696 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-1/wal/instance
I20260811 12:46:02.869401 745 external_mini_cluster.cc:1428] Setting key e849e5a3869a49240ebe6124464a4651
I20260811 12:46:02.871832 26807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:46:02.878623 26807 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:02 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:46:02.901726 26809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.881439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42860 (local address 127.0.186.126:39113)
0811 12:46:02.882003 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:02.882010 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:02.883213 (+ 1203us) server_negotiation.cc:407] Connection header received
0811 12:46:02.886301 (+ 3088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:02.886308 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:02.886410 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:02.886557 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:02.888295 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.889124 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.890745 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.891158 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.891303 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.895123 (+ 3820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:02.895128 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:02.895131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:02.895180 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:02.898189 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:02.899029 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:02.899036 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:02.899040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:02.899181 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:02.899721 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:02.899727 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:02.899732 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:02.900047 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:02.900217 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:02.901076 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 12:46:02.901316 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":271,"threads_started":1}
I20260811 12:46:02.902964 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.882069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39113 (local address 127.0.0.1:42860)
0811 12:46:02.882950 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.883020 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:02.885932 (+ 2912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:02.886854 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:02.886863 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:02.887448 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:02.888046 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.888065 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.889309 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.889313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.890583 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.890597 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.891428 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.891436 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.891675 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.892434 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:02.892465 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:02.894844 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:02.898359 (+ 3515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.898369 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.898389 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.898889 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:02.899306 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.899311 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.899315 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.899598 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:02.900195 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:02.900204 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:02.900610 (+ 406us) client_negotiation.cc:769] Sending connection context
0811 12:46:02.900967 (+ 357us) client_negotiation.cc:240] Negotiation successful
0811 12:46:02.901559 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":338,"threads_started":1}
WARNING: no policy specified for kudu/127.0.186.124@KRBTEST.COM; defaulting to no policy
I20260811 12:46:02.905051 26807 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.124@KRBTEST.COM" created.
Aug 11 12:46:02 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:46:02.921028 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.905972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40708)
0811 12:46:02.906229 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.906253 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:02.906387 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:02.907171 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:02.907176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:02.907628 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:02.907760 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.907769 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.909238 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.909245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.910169 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.910182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.911016 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.911021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.911204 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.911843 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:02.911861 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:02.914033 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:02.917887 (+ 3854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.917895 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.917900 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.918300 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:02.918796 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.918800 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.918802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.919066 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:02.919913 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:02.919917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:02.920104 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 12:46:02.920234 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 12:46:02.920550 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 12:46:02.921331 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.905968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40708 (local address 127.0.186.125:33823)
0811 12:46:02.906715 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:02.906721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:02.906745 (+ 24us) server_negotiation.cc:407] Connection header received
0811 12:46:02.906787 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:02.906793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:02.907014 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:02.907173 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:02.907941 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.909106 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.910313 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.910863 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.911011 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.914249 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:02.914261 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:02.914276 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:02.914310 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:02.917732 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:02.918468 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:02.918481 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:02.918487 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:02.918661 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:02.919185 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:02.919193 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:02.919198 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:02.919743 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:02.920013 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:02.920443 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 12:46:02.920759 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":314,"threads_started":1}
I20260811 12:46:02.923933 26807 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:46:02.925169 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.924644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:40962)
0811 12:46:02.924878 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.925002 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 12:46:02.925424 26753 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:02.927103 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.926748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:40970)
0811 12:46:02.926908 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.926991 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 12:46:02.927356 26807 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab.
Entry for principal kudu/127.0.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab.
I20260811 12:46:02.953807 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:35799
--webserver_interface=127.0.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab
--principal=kudu/127.0.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39113,127.0.186.125:33823,127.0.186.124:35799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:46:02.976679 26807 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 1
I20260811 12:46:02.978155 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.977527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:40974)
0811 12:46:02.977793 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.977929 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 12:46:02.979416 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.978918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:40988)
0811 12:46:02.979134 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.979242 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 12:46:02.979656 26807 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:02.987020 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } attempt: 5
Aug 11 12:46:02 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:46:03.002169 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.987793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:40720)
0811 12:46:02.988015 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:02.988037 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:02.988226 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:02.988614 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:02.988619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:02.989087 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:02.989287 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.989297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.990313 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.990319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.991180 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:02.991191 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.991980 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.991986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:02.992225 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.992954 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:02.992973 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:02.995250 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:02.999434 (+ 4184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:02.999438 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:02.999441 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:02.999985 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.000419 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.000423 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.000425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.000574 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.001314 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:03.001318 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:03.001468 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 12:46:03.001650 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 12:46:03.001895 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 12:46:03.002374 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:02.987839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40720 (local address 127.0.186.125:33823)
0811 12:46:02.988044 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:02.988051 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:02.988120 (+ 69us) server_negotiation.cc:407] Connection header received
0811 12:46:02.988375 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:02.988380 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:02.988463 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:02.988573 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:02.989449 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.990172 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.991338 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:02.991804 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:02.991952 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:02.995488 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:02.995496 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:02.995501 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:02.995547 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:02.999275 (+ 3728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.000111 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.000117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.000121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.000287 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.000757 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.000763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.000766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.001183 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.001345 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.001763 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.002037 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 12:46:03.003624 26725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:46:03.004878 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.004363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:40992)
0811 12:46:03.004557 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.004645 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 12:46:03.005903 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.005541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41004)
0811 12:46:03.005695 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.005800 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 12:46:03.006143 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.047922 26807 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 2
I20260811 12:46:03.049260 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.048668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41008)
0811 12:46:03.048924 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.049057 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 12:46:03.050370 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.049970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41012)
0811 12:46:03.050139 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.050227 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 12:46:03.050601 26807 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.057399 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 1
I20260811 12:46:03.058808 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.058280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41018)
0811 12:46:03.058480 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.058593 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 12:46:03.060344 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.059858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41028)
0811 12:46:03.060091 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.060197 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 12:46:03.060621 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.128851 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 2
I20260811 12:46:03.130177 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.129612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41042)
0811 12:46:03.129904 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.129994 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 12:46:03.131302 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.130944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41046)
0811 12:46:03.131089 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.131193 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 12:46:03.131554 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.141834 26807 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 3
I20260811 12:46:03.143074 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.142505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41054)
0811 12:46:03.142759 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.142865 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 12:46:03.144410 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.143809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41070)
0811 12:46:03.144106 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.144222 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260811 12:46:03.144706 26807 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.237835 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 3
I20260811 12:46:03.239236 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.238683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41074)
0811 12:46:03.238908 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.239009 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 12:46:03.240337 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.239976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41076)
0811 12:46:03.240142 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.240226 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 12:46:03.240621 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.287983 26807 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 4
I20260811 12:46:03.289471 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.288818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41084)
0811 12:46:03.289122 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.289241 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 12:46:03.290629 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.290207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:41090)
0811 12:46:03.290377 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.290475 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 12:46:03.290858 26807 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
W20260811 12:46:03.335785 26819 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 12:46:03.336126 26819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:46:03.336193 26819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:46:03.336277 26819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:46:03.343791 26819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:46:03.343891 26819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:46:03.343948 26819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:46:03.343994 26819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:46:03.344077 26819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:46:03.354393 26819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39113,127.0.186.125:33823,127.0.186.124:35799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab
--principal=kudu/127.0.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:35799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:46:03.355746 26819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:46:03.357161 26819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:46:03.369923 26824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:03.369999 26827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:03.369990 26825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:46:03.370929 26819 server_base.cc:1034] running on GCE node
I20260811 12:46:03.371749 26819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:46:03.373279 26819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:46:03.374528 26819 hybrid_clock.cc:648] HybridClock initialized: now 1786452363374418 us; error 65 us; skew 500 ppm
I20260811 12:46:03.374907 26819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452363, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:46:03.378328 26819 init.cc:377] Logged in from keytab as kudu/127.0.186.124@KRBTEST.COM (short username kudu)
I20260811 12:46:03.379918 26819 webserver.cc:460] Webserver started at http://127.0.186.124:35187/ using document root <none> and password file <none>
I20260811 12:46:03.380616 26819 fs_manager.cc:359] Metadata directory not provided
I20260811 12:46:03.380709 26819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:46:03.381088 26819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:46:03.384295 26819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data/instance:
uuid: "18da079024df40da9787e34a77dd0f8e"
format_stamp: "Formatted at 2026-08-11 12:46:03 on dist-test-slave-qg60"
server_key: "712b35d5ec019bbf897ba8d5e58419df"
server_key_iv: "5ac6b8df5e4aefeacf52169c4c0b4d47"
server_key_version: "encryptionkey@0"
I20260811 12:46:03.385203 26819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal/instance:
uuid: "18da079024df40da9787e34a77dd0f8e"
format_stamp: "Formatted at 2026-08-11 12:46:03 on dist-test-slave-qg60"
server_key: "712b35d5ec019bbf897ba8d5e58419df"
server_key_iv: "5ac6b8df5e4aefeacf52169c4c0b4d47"
server_key_version: "encryptionkey@0"
I20260811 12:46:03.390815 26819 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:46:03.394588 26834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:46:03.396080 26819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 12:46:03.396245 26819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal
uuid: "18da079024df40da9787e34a77dd0f8e"
format_stamp: "Formatted at 2026-08-11 12:46:03 on dist-test-slave-qg60"
server_key: "712b35d5ec019bbf897ba8d5e58419df"
server_key_iv: "5ac6b8df5e4aefeacf52169c4c0b4d47"
server_key_version: "encryptionkey@0"
I20260811 12:46:03.396445 26819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:46:03.409433 26819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:46:03.413571 26819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:46:03.413810 26819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:46:03.417848 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 4
I20260811 12:46:03.418936 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.418494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:53410)
0811 12:46:03.418715 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.418798 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 12:46:03.420389 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.419756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:53418)
0811 12:46:03.420019 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.420159 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 12:46:03.420644 26725 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:35799: Network error: Client connection negotiation failed: client connection to 127.0.186.124:35799: connect: Connection refused (error 111)
I20260811 12:46:03.434334 26819 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.124:35799
I20260811 12:46:03.434342 26889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.124:35799 every 8 connection(s)
I20260811 12:46:03.435866 26819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
I20260811 12:46:03.439913 26890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:46:03.445940 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 26819
I20260811 12:46:03.446173 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786451972721996-745-0/minicluster-data/master-2/wal/instance
I20260811 12:46:03.446614 745 external_mini_cluster.cc:1428] Setting key 5b011fffc62bb195a35182ffcfae33f5
I20260811 12:46:03.446978 26890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452363, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:46:03.468675 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.450514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37918 (local address 127.0.186.126:39113)
0811 12:46:03.451138 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.451148 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.451755 (+ 607us) server_negotiation.cc:407] Connection header received
0811 12:46:03.452635 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.452642 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.452775 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.452906 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.454242 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.455012 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.456562 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.457095 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.457249 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.461180 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.461185 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.461189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.461252 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.465093 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.465988 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.465996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.466002 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.466190 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.466706 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.466712 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.466715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.467008 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.467192 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.467961 (+ 769us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.468255 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":290,"threads_started":1}
I20260811 12:46:03.469933 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.448722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53426 (local address 127.0.186.124:35799)
0811 12:46:03.449706 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.449716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.449755 (+ 39us) server_negotiation.cc:407] Connection header received
0811 12:46:03.452296 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.452317 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.452561 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.452795 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.454380 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.455511 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.456884 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.457423 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.457650 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.462396 (+ 4746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.462410 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.462429 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.462474 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.466404 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.467178 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.467195 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.467198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.467344 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.467756 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.467761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.467764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.468133 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.468492 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.469061 (+ 569us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.469330 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":721,"spinlock_wait_cycles":27904,"thread_start_us":432,"threads_started":1}
I20260811 12:46:03.470037 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.450603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39113 (local address 127.0.0.1:37918)
0811 12:46:03.451588 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.451633 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:03.452337 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:03.452990 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:03.452998 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:03.453645 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:03.454019 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.454036 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.455204 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.455208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.456399 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.456412 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.457341 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.457353 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.457579 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.458475 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:03.458509 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:03.460916 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:03.465259 (+ 4343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.465274 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.465284 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.465850 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.466323 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.466330 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.466332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.466508 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.467161 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:03.467170 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:03.467557 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 12:46:03.467868 (+ 311us) client_negotiation.cc:240] Negotiation successful
0811 12:46:03.468407 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":21,"thread_start_us":586,"threads_started":1}
I20260811 12:46:03.471632 26890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452363, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:46:03.486671 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.472628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.0.186.125:33823)
0811 12:46:03.472834 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.472840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.472860 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:46:03.473173 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.473180 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.473280 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.473387 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.474371 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.475077 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.476416 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.476956 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.477063 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.480443 (+ 3380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.480449 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.480452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.480493 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.483573 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.484430 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.484434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.484437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.484604 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.485095 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.485102 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.485108 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.485443 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.485583 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.486202 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.486383 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 12:46:03.486804 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.472372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:33823 (local address 127.0.0.1:35824)
0811 12:46:03.472592 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.472613 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:03.472956 (+ 343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:03.473452 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:03.473459 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:03.473976 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:03.474194 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.474207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.475230 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.475236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.476249 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.476262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.477126 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.477132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.477383 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.478080 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:03.478098 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:03.480236 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:03.483712 (+ 3476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.483719 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.483726 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.484293 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.484749 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.484758 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.484764 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.484974 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.485598 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:03.485605 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:03.485799 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 12:46:03.486084 (+ 285us) client_negotiation.cc:240] Negotiation successful
0811 12:46:03.486404 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 12:46:03.487916 26890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:46:03.489941 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.473535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37920 (local address 127.0.186.126:39113)
0811 12:46:03.473733 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.473738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.473901 (+ 163us) server_negotiation.cc:407] Connection header received
0811 12:46:03.474030 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.474034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.474112 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.474197 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.475533 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.476290 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.477919 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.478357 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.478495 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.483339 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.483344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.483347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.483385 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.486799 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.487600 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.487606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.487610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.487771 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.488208 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.488214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.488217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.488624 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.488989 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.489342 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.489582 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452363, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:46:03.505142 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.488886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53430 (local address 127.0.186.124:35799)
0811 12:46:03.489092 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.489099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.489119 (+ 20us) server_negotiation.cc:407] Connection header received
0811 12:46:03.489300 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.489307 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.489381 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.489493 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.490349 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.491332 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.492664 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.493429 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.493579 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.497537 (+ 3958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.497543 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.497546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.497579 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.501631 (+ 4052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.502590 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.502598 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.502607 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.502748 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.503265 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.503269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.503271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.503612 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.503810 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.504365 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.504588 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":80}
I20260811 12:46:03.505439 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.488748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:53430)
0811 12:46:03.489058 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.489074 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:03.489152 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:03.489539 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:03.489544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:03.490029 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:03.490214 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.490224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.491502 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.491510 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.492520 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.492532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.493608 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.493613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.493808 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.494417 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:03.494444 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:03.497321 (+ 2877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:03.501820 (+ 4499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.501827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.501833 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.502361 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.502881 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.502887 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.502894 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.503090 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.503866 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:03.503871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:03.504073 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 12:46:03.504263 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 12:46:03.504855 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":135}
I20260811 12:46:03.510994 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.491828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35828 (local address 127.0.186.125:33823)
0811 12:46:03.492016 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.492022 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.492095 (+ 73us) server_negotiation.cc:407] Connection header received
0811 12:46:03.492165 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.492170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.492244 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.492348 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.494141 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.495296 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.497068 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.497652 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.497749 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.503826 (+ 6077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.503837 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.503844 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.503893 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.507750 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.508576 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.508583 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.508587 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.508813 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.509323 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.509329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.509333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.509680 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.510011 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.510344 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.510620 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 12:46:03.511324 26890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: Bootstrap starting.
I20260811 12:46:03.515798 26890 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:03.516835 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:46:03.517249 26890 log.cc:824] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:03.520987 26890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: No bootstrap required, opened a new log
I20260811 12:46:03.520331 26696 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0f16420c03864bc186a377d21122a6a7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37920
I20260811 12:46:03.528522 26890 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.528980 26890 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18da079024df40da9787e34a77dd0f8e, State: Initialized, Role: FOLLOWER
I20260811 12:46:03.529489 26890 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.530540 26898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.530943 26898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:03.531725 26890 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:46:03.542613 26912 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:46:03.542778 26912 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:46:03.540056 26819 master_runner.cc:186] Error getting master registration for 127.0.186.126:39113: OK, instance_id { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" instance_seqno: 1786452362268141 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 12:46:03.551968 26819 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 12:46:03.590106 26807 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 5
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:46:03.608314 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.590950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:53444)
0811 12:46:03.591197 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.591221 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:03.591366 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:03.591745 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:03.591751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:03.592318 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:03.592558 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.592572 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.594167 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.594173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.595638 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.595656 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.596698 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.596704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.596953 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.597659 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:03.597687 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:03.600848 (+ 3161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:03.605156 (+ 4308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.605162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.605166 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.605755 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.606205 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.606211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.606215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.606405 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.607211 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:03.607216 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:03.607403 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 12:46:03.607594 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 12:46:03.607900 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 12:46:03.608330 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.591047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53444 (local address 127.0.186.124:35799)
0811 12:46:03.591249 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.591253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.591280 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:46:03.591501 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.591505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.591571 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.591713 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.592803 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.593996 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.595801 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.596526 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.596687 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.601117 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.601124 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.601129 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.601176 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.604995 (+ 3819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.605898 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.605903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.605907 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.606067 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.606559 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.606563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.606568 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.607063 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.607228 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.607697 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.607941 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:46:03.614848 26807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: Bootstrap starting.
I20260811 12:46:03.618518 26807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:03.619943 26807 log.cc:824] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:03.623066 26807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: No bootstrap required, opened a new log
I20260811 12:46:03.630637 26807 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.631016 26807 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4929f26d8f0c425f99c85b255bcf4af7, State: Initialized, Role: FOLLOWER
I20260811 12:46:03.631650 26807 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.632804 26916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.633299 26916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:03.634032 26807 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:46:03.644572 26928 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:46:03.644830 26928 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:46:03.642073 26733 master_runner.cc:186] Error getting master registration for 127.0.186.126:39113: OK, instance_id { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" instance_seqno: 1786452362268141 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 12:46:03.654031 26733 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 12:46:03.666071 26841 tablet.cc:2369] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:46:03.697878 26725 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } attempt: 5
Aug 11 12:46:03 dist-test-slave-qg60 krb5kdc[26636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:46:03.720024 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.698931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.0.186.124:35799)
0811 12:46:03.699149 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.699161 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.699345 (+ 184us) server_negotiation.cc:407] Connection header received
0811 12:46:03.699452 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.699458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.699726 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.699843 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.701224 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.702375 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.704793 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.705492 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.705641 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.711591 (+ 5950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.711604 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.711609 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.711673 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.715671 (+ 3998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.716580 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.716586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.716590 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.716809 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.717354 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.717359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.717363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.717753 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.717900 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.719301 (+ 1401us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.719576 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 12:46:03.720486 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.698742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:35799 (local address 127.0.0.1:53456)
0811 12:46:03.699151 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:03.699177 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:03.699326 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:03.700094 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:03.700101 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:03.700698 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:03.701018 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.701035 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.702559 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.702565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.704142 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:03.704160 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.705880 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.705886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:03.706107 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.706968 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:03.706995 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:03.711335 (+ 4340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:03.715865 (+ 4530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.715871 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.715875 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.716418 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.716973 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:03.716979 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:03.716983 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:03.717200 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:03.718046 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:03.718051 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:03.718226 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 12:46:03.718388 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 12:46:03.718714 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239}
I20260811 12:46:03.727384 26725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7: Bootstrap starting.
I20260811 12:46:03.731952 26725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:03.733584 26725 log.cc:824] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:03.737707 26725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7: No bootstrap required, opened a new log
I20260811 12:46:03.745983 26725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.746418 26725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f16420c03864bc186a377d21122a6a7, State: Initialized, Role: FOLLOWER
I20260811 12:46:03.746978 26725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.748402 26931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.749222 26931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:03.749648 26725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:46:03.749740 26696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 12:46:03.749958 26696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:46:03.753482 26696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.756165 26781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f16420c03864bc186a377d21122a6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4929f26d8f0c425f99c85b255bcf4af7"
I20260811 12:46:03.756865 26781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [term 0 FOLLOWER]: Advancing to term 1
W20260811 12:46:03.756974 26675 tablet.cc:2369] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:46:03.757856 26696 leader_election.cc:288] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [CANDIDATE]: Term 1 election: Requested vote from peers 4929f26d8f0c425f99c85b255bcf4af7 (127.0.186.125:33823), 18da079024df40da9787e34a77dd0f8e (127.0.186.124:35799)
I20260811 12:46:03.761831 26781 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f16420c03864bc186a377d21122a6a7 in term 1.
I20260811 12:46:03.763095 26671 leader_election.cc:302] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f16420c03864bc186a377d21122a6a7, 4929f26d8f0c425f99c85b255bcf4af7; no voters:
I20260811 12:46:03.763882 26863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f16420c03864bc186a377d21122a6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "18da079024df40da9787e34a77dd0f8e"
I20260811 12:46:03.764605 26863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:46:03.764909 26931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:46:03.770007 26863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f16420c03864bc186a377d21122a6a7 in term 1.
I20260811 12:46:03.773052 26931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [term 1 LEADER]: Becoming Leader. State: Replica: 0f16420c03864bc186a377d21122a6a7, State: Running, Role: LEADER
I20260811 12:46:03.773901 26931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } }
I20260811 12:46:03.784003 26936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f16420c03864bc186a377d21122a6a7. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.784674 26936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:03.801287 26942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:46:03.822149 26942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:46:03.835222 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.790059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35844 (local address 127.0.186.125:33823)
0811 12:46:03.790353 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.790368 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.798691 (+ 8323us) server_negotiation.cc:407] Connection header received
0811 12:46:03.801964 (+ 3273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.801970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.802052 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.802121 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.808466 (+ 6345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.809979 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.818322 (+ 8343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.819009 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.819116 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.826679 (+ 7563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.826688 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.826692 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.826753 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.830554 (+ 3801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.832232 (+ 1678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.832238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.832242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.832405 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.832913 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.832921 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.832930 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.833320 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.833589 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.834352 (+ 763us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.834687 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:46:03.847245 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.800076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.0.186.124:35799)
0811 12:46:03.800350 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.800359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.817573 (+ 17214us) server_negotiation.cc:407] Connection header received
0811 12:46:03.817912 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.817921 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.818066 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.818158 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.821409 (+ 3251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.822842 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.825753 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.826676 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.826815 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.831099 (+ 4284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.831110 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.831118 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.831181 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.835813 (+ 4632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.837034 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.837043 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.837055 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.837258 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.837817 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.837825 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.837831 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.838314 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.838630 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.846206 (+ 7576us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.846633 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
W20260811 12:46:03.848804 26758 tablet.cc:2369] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:46:03.850314 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:03.792459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.0.186.126:39113)
0811 12:46:03.792665 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:03.792674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:03.799223 (+ 6549us) server_negotiation.cc:407] Connection header received
0811 12:46:03.801272 (+ 2049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:03.801278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:03.801591 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:03.801709 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:03.812306 (+ 10597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.813529 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.817366 (+ 3837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:03.818492 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:03.818642 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:03.831662 (+ 13020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:03.831669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:03.831673 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:03.831719 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:03.845675 (+ 13956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.846798 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.846804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.846807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.847015 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:03.847518 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:03.847523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:03.847526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:03.847979 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:03.849478 (+ 1499us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:03.849628 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 12:46:03.849930 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 12:46:03.863772 26863 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [term 1 FOLLOWER]: Refusing update from remote peer 0f16420c03864bc186a377d21122a6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:46:03.865509 26936 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:46:03.872826 26781 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [term 1 FOLLOWER]: Refusing update from remote peer 0f16420c03864bc186a377d21122a6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:46:03.873801 26936 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:46:03.876173 26957 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 12:46:03.884158 26898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f16420c03864bc186a377d21122a6a7. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.884539 26898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:03.887370 26956 mvcc.cc:205] Tried to move back new op lower bound from 7317308882323193856 to 7317308882035867648. Current Snapshot: MvccSnapshot[applied={T|T < 7317308882323193856}]
I20260811 12:46:03.888161 26958 mvcc.cc:205] Tried to move back new op lower bound from 7317308882323193856 to 7317308882035867648. Current Snapshot: MvccSnapshot[applied={T|T < 7317308882323193856}]
I20260811 12:46:03.899606 26898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.899959 26898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:03.904517 26936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.904903 26936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:03.905076 26942 catalog_manager.cc:1347] Generated new cluster ID: a1fae6a1289046d9b7d735431be95bd6
I20260811 12:46:03.905175 26942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:46:03.921278 26916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f16420c03864bc186a377d21122a6a7. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.921624 26916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:03.933326 26942 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:46:03.935369 26942 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:46:03.949911 26964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.950465 26964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7 [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:03.956856 26942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f16420c03864bc186a377d21122a6a7: Generated new TSK 0
I20260811 12:46:03.958416 26942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:46:03.971369 26916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f16420c03864bc186a377d21122a6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16420c03864bc186a377d21122a6a7" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39113 } } peers { permanent_uuid: "4929f26d8f0c425f99c85b255bcf4af7" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 33823 } } peers { permanent_uuid: "18da079024df40da9787e34a77dd0f8e" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 35799 } } }
I20260811 12:46:03.971657 26916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 12:46:04.138484 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.128707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35852 (local address 127.0.186.125:33823)
0811 12:46:04.128948 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.128957 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.136002 (+ 7045us) server_negotiation.cc:407] Connection header received
0811 12:46:04.136537 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.136545 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.136678 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.136792 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.138190 (+ 1398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35852: BlockingRecv error: recv got EOF from 127.0.0.1:35852 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 12:46:04.141412 26895 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.128229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37944 (local address 127.0.186.126:39113)
0811 12:46:04.128479 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.128487 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.139341 (+ 10854us) server_negotiation.cc:407] Connection header received
0811 12:46:04.139603 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.139610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.139712 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.139794 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.141072 (+ 1278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37944: BlockingRecv error: recv got EOF from 127.0.0.1:37944 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 12:46:04.146101 26893 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.143366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53478 (local address 127.0.186.124:35799)
0811 12:46:04.143550 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.143557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.144207 (+ 650us) server_negotiation.cc:407] Connection header received
0811 12:46:04.144460 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.144465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.144549 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.144621 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.145848 (+ 1227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53478: BlockingRecv error: recv got EOF from 127.0.0.1:53478 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 12:46:04.195339 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.186913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.0.186.125:33823)
0811 12:46:04.187152 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.187158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.193476 (+ 6318us) server_negotiation.cc:407] Connection header received
0811 12:46:04.193766 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.193773 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.193922 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.194062 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.195011 (+ 949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35856: BlockingRecv error: recv got EOF from 127.0.0.1:35856 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260811 12:46:04.203274 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.201207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35864 (local address 127.0.186.125:33823)
0811 12:46:04.201433 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.201442 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.201680 (+ 238us) server_negotiation.cc:407] Connection header received
0811 12:46:04.201901 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.201907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.202002 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.202125 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.203009 (+ 884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35864: BlockingRecv error: recv got EOF from 127.0.0.1:35864 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260811 12:46:04.215179 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.209033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35878 (local address 127.0.186.125:33823)
0811 12:46:04.209262 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.209270 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.213437 (+ 4167us) server_negotiation.cc:407] Connection header received
0811 12:46:04.213668 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.213674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.213781 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.213898 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.214873 (+ 975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35878: BlockingRecv error: recv got EOF from 127.0.0.1:35878 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 12:46:04.229522 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.226974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.0.186.125:33823)
0811 12:46:04.227249 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.227257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.227803 (+ 546us) server_negotiation.cc:407] Connection header received
0811 12:46:04.228030 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.228038 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.228168 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.228286 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.229253 (+ 967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35890: BlockingRecv error: recv got EOF from 127.0.0.1:35890 (error 108)
Metrics: {"server-negotiator.queue_time_us":142}
W20260811 12:46:04.245409 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.242907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35902 (local address 127.0.186.125:33823)
0811 12:46:04.243144 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.243151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.243768 (+ 617us) server_negotiation.cc:407] Connection header received
0811 12:46:04.243974 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.243980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.244075 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.244211 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.245103 (+ 892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35902: BlockingRecv error: recv got EOF from 127.0.0.1:35902 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 12:46:04.268033 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.265397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35906 (local address 127.0.186.125:33823)
0811 12:46:04.265653 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.265660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.266235 (+ 575us) server_negotiation.cc:407] Connection header received
0811 12:46:04.266444 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.266450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.266568 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.266700 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.267716 (+ 1016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35906: BlockingRecv error: recv got EOF from 127.0.0.1:35906 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260811 12:46:04.306175 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.303897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35922 (local address 127.0.186.125:33823)
0811 12:46:04.304136 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.304143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.304552 (+ 409us) server_negotiation.cc:407] Connection header received
0811 12:46:04.304753 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.304762 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.304872 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.304997 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.305846 (+ 849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35922: BlockingRecv error: recv got EOF from 127.0.0.1:35922 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 12:46:04.377575 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.375067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35924 (local address 127.0.186.125:33823)
0811 12:46:04.375326 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.375334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.375758 (+ 424us) server_negotiation.cc:407] Connection header received
0811 12:46:04.376022 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.376027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.376108 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.376236 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.377339 (+ 1103us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35924: BlockingRecv error: recv got EOF from 127.0.0.1:35924 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 12:46:04.512224 26816 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:04.509824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35930 (local address 127.0.186.125:33823)
0811 12:46:04.510107 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.510118 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.510526 (+ 408us) server_negotiation.cc:407] Connection header received
0811 12:46:04.510791 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.510803 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.510885 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.511013 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:04.511947 (+ 934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35930: BlockingRecv error: recv got EOF from 127.0.0.1:35930 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 12:46:04.545197 26912 catalog_manager.cc:1259] Loaded cluster ID: a1fae6a1289046d9b7d735431be95bd6
I20260811 12:46:04.545317 26912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: loading cluster ID for follower catalog manager: success
I20260811 12:46:04.548350 26912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: acquiring CA information for follower catalog manager: success
I20260811 12:46:04.550796 26912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18da079024df40da9787e34a77dd0f8e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:46:04.647152 26928 catalog_manager.cc:1259] Loaded cluster ID: a1fae6a1289046d9b7d735431be95bd6
I20260811 12:46:04.647260 26928 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: loading cluster ID for follower catalog manager: success
I20260811 12:46:04.650126 26928 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: acquiring CA information for follower catalog manager: success
I20260811 12:46:04.652192 26928 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4929f26d8f0c425f99c85b255bcf4af7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:46:04.780891 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:04.774704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.0.186.125:33823)
0811 12:46:04.774913 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.774918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.775303 (+ 385us) server_negotiation.cc:407] Connection header received
0811 12:46:04.775480 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.775484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.775670 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.775812 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:04.776362 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.777164 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.778584 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.778972 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.779067 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:04.779688 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:04.780266 (+ 578us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:04.780384 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:04.780506 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 12:46:04.780582 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 12:46:04.797427 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:04.791284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.0.186.124:35799)
0811 12:46:04.791820 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.791825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.791968 (+ 143us) server_negotiation.cc:407] Connection header received
0811 12:46:04.792195 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.792199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.792377 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.792575 (+ 198us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:04.793037 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.793778 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.795081 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.795492 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.795636 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:04.796177 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:04.796717 (+ 540us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:04.796928 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:04.797005 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 12:46:04.797097 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":272,"threads_started":1}
I20260811 12:46:04.814602 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:04.805248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.0.186.126:39113)
0811 12:46:04.806173 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.806180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.807160 (+ 980us) server_negotiation.cc:407] Connection header received
0811 12:46:04.807358 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.807368 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.807702 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.807946 (+ 244us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:04.808768 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.809868 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.812033 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.812544 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.812690 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:04.813322 (+ 632us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:04.813870 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:04.813990 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:04.814098 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 12:46:04.814206 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":445,"threads_started":1}
I20260811 12:46:04.814620 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:04.804816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.0.186.125:33823)
0811 12:46:04.805056 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.805065 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.807257 (+ 2192us) server_negotiation.cc:407] Connection header received
0811 12:46:04.807467 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.807476 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.807606 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.807707 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:04.808524 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.809831 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.812409 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.813147 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.813267 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:04.813684 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:04.813798 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:04.813898 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:04.814246 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 12:46:04.814332 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 12:46:04.814970 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:04.806751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53498 (local address 127.0.186.124:35799)
0811 12:46:04.807088 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:04.807097 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:04.807925 (+ 828us) server_negotiation.cc:407] Connection header received
0811 12:46:04.808229 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:04.808235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:04.808350 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:04.808465 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:04.809325 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.810273 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.812611 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:04.813241 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:04.813380 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:04.814094 (+ 714us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:04.814247 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:04.814319 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:04.814590 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 12:46:04.814690 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 12:46:04.820904 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26651
I20260811 12:46:04.822182 26718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:46:04.935830 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26651
I20260811 12:46:04.964249 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26733
I20260811 12:46:04.965615 26801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:46:05.080847 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26733
I20260811 12:46:05.107864 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 26819
I20260811 12:46:05.109114 26885 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:46:05.220446 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 26819
2026-08-11T12:46:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5106 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 12:46:05 dist-test-slave-qg60 krb5kdc[27055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 12:46:05 dist-test-slave-qg60 krb5kdc[27055](info): set up 2 sockets
Aug 11 12:46:05 dist-test-slave-qg60 krb5kdc[27055](info): commencing operation
krb5kdc: starting...
W20260811 12:46:06.573769 745 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.004s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/test-user.keytab.
Aug 11 12:46:06 dist-test-slave-qg60 krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T12:46:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:46:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
Entry for principal kudu/127.0.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab.
I20260811 12:46:06.976358 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39823
--webserver_interface=127.0.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39823,127.0.186.125:46129,127.0.186.124:46069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 12:46:07.347056 27070 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 12:46:07.347465 27070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:46:07.347594 27070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:46:07.347740 27070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:46:07.355360 27070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:46:07.355497 27070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:46:07.355611 27070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:46:07.355707 27070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:46:07.355803 27070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:46:07.366364 27070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39823,127.0.186.125:46129,127.0.186.124:46069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.126.keytab
--principal=kudu/127.0.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.126:39823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:46:07.367918 27070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:46:07.369444 27070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:46:07.381932 27075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:07.381896 27078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:07.381974 27076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:46:07.383392 27070 server_base.cc:1034] running on GCE node
I20260811 12:46:07.384238 27070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:46:07.385818 27070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:46:07.387050 27070 hybrid_clock.cc:648] HybridClock initialized: now 1786452367386982 us; error 36 us; skew 500 ppm
I20260811 12:46:07.387414 27070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:46:07 dist-test-slave-qg60 krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:46:07.390925 27070 init.cc:377] Logged in from keytab as kudu/127.0.186.126@KRBTEST.COM (short username kudu)
I20260811 12:46:07.392452 27070 webserver.cc:460] Webserver started at http://127.0.186.126:33533/ using document root <none> and password file <none>
I20260811 12:46:07.393265 27070 fs_manager.cc:359] Metadata directory not provided
I20260811 12:46:07.393363 27070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:46:07.393666 27070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:46:07.396912 27070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data/instance:
uuid: "57ef242749b2495b9f4b6c467c74463e"
format_stamp: "Formatted at 2026-08-11 12:46:07 on dist-test-slave-qg60"
server_key: "4ed227517fe475df177e72b7adb5c102"
server_key_iv: "6f5276676a6cd1000ef510659e9856e7"
server_key_version: "encryptionkey@0"
I20260811 12:46:07.397728 27070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal/instance:
uuid: "57ef242749b2495b9f4b6c467c74463e"
format_stamp: "Formatted at 2026-08-11 12:46:07 on dist-test-slave-qg60"
server_key: "4ed227517fe475df177e72b7adb5c102"
server_key_iv: "6f5276676a6cd1000ef510659e9856e7"
server_key_version: "encryptionkey@0"
I20260811 12:46:07.403329 27070 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 12:46:07.407080 27086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:46:07.408569 27070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 12:46:07.408834 27070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal
uuid: "57ef242749b2495b9f4b6c467c74463e"
format_stamp: "Formatted at 2026-08-11 12:46:07 on dist-test-slave-qg60"
server_key: "4ed227517fe475df177e72b7adb5c102"
server_key_iv: "6f5276676a6cd1000ef510659e9856e7"
server_key_version: "encryptionkey@0"
I20260811 12:46:07.409109 27070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:46:07.434397 27070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:46:07.438920 27070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:46:07.439236 27070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:46:07.459365 27070 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.126:39823
I20260811 12:46:07.459386 27139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.126:39823 every 8 connection(s)
I20260811 12:46:07.460896 27070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/data/info.pb
I20260811 12:46:07.465194 27140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:46:07.466287 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 27070
I20260811 12:46:07.466500 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-0/wal/instance
I20260811 12:46:07.466990 745 external_mini_cluster.cc:1428] Setting key 64f80d7b55ce5ff53d54589d879feb28
I20260811 12:46:07.474442 27140 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:07 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:46:07.500880 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.477801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39823 (local address 127.0.0.1:48898)
0811 12:46:07.478750 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.478810 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:07.481216 (+ 2406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:07.482324 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:07.482329 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:07.482930 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:07.483314 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:07.483333 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:07.485487 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:07.485495 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:07.487480 (+ 1985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:07.487499 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:07.488492 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:07.488502 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:07.488776 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:07.489596 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:07.489632 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:07.492434 (+ 2802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:07.495916 (+ 3482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:07.495930 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:07.495945 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:07.496378 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:07.496877 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:07.496883 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:07.496887 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:07.497075 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:07.497960 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:07.497969 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:07.498272 (+ 303us) client_negotiation.cc:769] Sending connection context
0811 12:46:07.498558 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 12:46:07.499301 (+ 743us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":228,"thread_start_us":391,"threads_started":1}
I20260811 12:46:07.500921 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.479221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48898 (local address 127.0.186.126:39823)
0811 12:46:07.480065 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:07.480076 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:07.480139 (+ 63us) server_negotiation.cc:407] Connection header received
0811 12:46:07.481643 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:07.481654 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:07.482024 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:07.482257 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:07.483552 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:07.485312 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:07.487661 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:07.488223 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:07.488367 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:07.492778 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:07.492791 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:07.492817 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:07.492848 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:07.495753 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:07.496525 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:07.496535 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:07.496540 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:07.496709 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:07.497210 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:07.497215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:07.497218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:07.497801 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:07.498029 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:07.498712 (+ 683us) server_negotiation.cc:299] Negotiation successful
0811 12:46:07.499172 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":608,"thread_start_us":416,"threads_started":1}
I20260811 12:46:07.504074 27140 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:46:07.505488 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.505079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42248)
0811 12:46:07.505257 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.505369 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.0.186.125@KRBTEST.COM; defaulting to no policy
W20260811 12:46:07.505797 27090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
I20260811 12:46:07.507472 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.507056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42260)
0811 12:46:07.507268 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.507337 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260811 12:46:07.507736 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:46129: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab.
Entry for principal kudu/127.0.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab.
I20260811 12:46:07.552958 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:46129
--webserver_interface=127.0.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab
--principal=kudu/127.0.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39823,127.0.186.125:46129,127.0.186.124:46069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:46:07.557103 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } attempt: 1
I20260811 12:46:07.558357 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.557865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42274)
0811 12:46:07.558082 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.558221 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 12:46:07.559393 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.559035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42288)
0811 12:46:07.559188 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.559261 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 12:46:07.559587 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:46129: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
I20260811 12:46:07.627882 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } attempt: 2
I20260811 12:46:07.629347 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.628793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42296)
0811 12:46:07.629104 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.629206 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260811 12:46:07.630427 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.630044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42312)
0811 12:46:07.630197 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.630290 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 12:46:07.630630 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:46129: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
I20260811 12:46:07.721894 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } attempt: 3
I20260811 12:46:07.723227 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.722717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42322)
0811 12:46:07.722938 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.723083 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 12:46:07.724310 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.723919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42326)
0811 12:46:07.724088 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.724159 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 12:46:07.724502 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:46129: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
I20260811 12:46:07.867790 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } attempt: 4
I20260811 12:46:07.869411 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.868756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42340)
0811 12:46:07.869153 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.869249 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230}
I20260811 12:46:07.870638 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:07.870232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42354)
0811 12:46:07.870405 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:07.870497 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 12:46:07.870846 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.125:46129: Network error: Client connection negotiation failed: client connection to 127.0.186.125:46129: connect: Connection refused (error 111)
W20260811 12:46:07.922705 27149 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 12:46:07.923141 27149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:46:07.923272 27149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:46:07.923410 27149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:46:07.931275 27149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:46:07.931422 27149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:46:07.931561 27149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:46:07.931648 27149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:46:07.931756 27149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:46:07.942528 27149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39823,127.0.186.125:46129,127.0.186.124:46069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.125.keytab
--principal=kudu/127.0.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.125:46129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:46:07.944041 27149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:46:07.945467 27149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:46:07.958549 27154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:07.958453 27155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:07.958511 27158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:46:07.959421 27149 server_base.cc:1034] running on GCE node
I20260811 12:46:07.960309 27149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:46:07.962070 27149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:46:07.963358 27149 hybrid_clock.cc:648] HybridClock initialized: now 1786452367963293 us; error 48 us; skew 500 ppm
I20260811 12:46:07.963740 27149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:46:07 dist-test-slave-qg60 krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:46:07.976296 27149 init.cc:377] Logged in from keytab as kudu/127.0.186.125@KRBTEST.COM (short username kudu)
I20260811 12:46:07.978272 27149 webserver.cc:460] Webserver started at http://127.0.186.125:39081/ using document root <none> and password file <none>
I20260811 12:46:07.979077 27149 fs_manager.cc:359] Metadata directory not provided
I20260811 12:46:07.979236 27149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:46:07.979605 27149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:46:07.983027 27149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data/instance:
uuid: "a96a13ffdf66453e8dd828faf7db26f3"
format_stamp: "Formatted at 2026-08-11 12:46:07 on dist-test-slave-qg60"
server_key: "d40c7e949a0d0b51909d50a0491dff35"
server_key_iv: "083dc1f53a42bb4ca6ad686850d1893d"
server_key_version: "encryptionkey@0"
I20260811 12:46:07.983914 27149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal/instance:
uuid: "a96a13ffdf66453e8dd828faf7db26f3"
format_stamp: "Formatted at 2026-08-11 12:46:07 on dist-test-slave-qg60"
server_key: "d40c7e949a0d0b51909d50a0491dff35"
server_key_iv: "083dc1f53a42bb4ca6ad686850d1893d"
server_key_version: "encryptionkey@0"
I20260811 12:46:07.989748 27149 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 12:46:07.993887 27165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:46:07.995473 27149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 12:46:07.995702 27149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal
uuid: "a96a13ffdf66453e8dd828faf7db26f3"
format_stamp: "Formatted at 2026-08-11 12:46:07 on dist-test-slave-qg60"
server_key: "d40c7e949a0d0b51909d50a0491dff35"
server_key_iv: "083dc1f53a42bb4ca6ad686850d1893d"
server_key_version: "encryptionkey@0"
I20260811 12:46:07.995977 27149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:46:08.017155 27149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:46:08.021848 27149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:46:08.022176 27149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:46:08.042306 27149 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.125:46129
I20260811 12:46:08.042344 27224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.125:46129 every 8 connection(s)
I20260811 12:46:08.043787 27149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/data/info.pb
I20260811 12:46:08.048089 27226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:46:08.053798 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 27149
I20260811 12:46:08.054014 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-1/wal/instance
I20260811 12:46:08.054476 745 external_mini_cluster.cc:1428] Setting key fe2654beb027217bbab77a8a6337d51f
I20260811 12:46:08.055889 27226 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:46:08.081314 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.058896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48900 (local address 127.0.186.126:39823)
0811 12:46:08.059621 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.059626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.060559 (+ 933us) server_negotiation.cc:407] Connection header received
0811 12:46:08.062797 (+ 2238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.062803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.062919 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.063058 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.064849 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.065716 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.067479 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.068254 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.068424 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.073553 (+ 5129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.073558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.073562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.073602 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.076995 (+ 3393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.078113 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.078123 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.078129 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.078309 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.078896 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.078906 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.078913 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.079441 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.079628 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.080393 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.080707 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":453,"threads_started":1}
I20260811 12:46:08.081979 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.059437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39823 (local address 127.0.0.1:48900)
0811 12:46:08.060292 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.060335 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.062476 (+ 2141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.063343 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.063352 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.063949 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.064578 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.064596 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.065912 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.065916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.067258 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.067272 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.068519 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.068528 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.068903 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.069762 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.069797 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.073289 (+ 3492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.077214 (+ 3925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.077225 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.077243 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.077980 (+ 737us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.078469 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.078474 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.078478 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.078740 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.079604 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.079611 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.079983 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.080242 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.080680 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":370,"threads_started":1}
I20260811 12:46:08.084077 27226 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.186.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.186.124@KRBTEST.COM" created.
I20260811 12:46:08.101020 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.085182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42356)
0811 12:46:08.085394 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.085414 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.085523 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.086572 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.086577 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.087102 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.087244 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.087253 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.088700 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.088707 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.089608 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.089630 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.090486 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.090491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.090769 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.091411 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.091429 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.094013 (+ 2584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.097767 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.097771 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.097774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.098186 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.098669 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.098673 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.098676 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.098861 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.099938 (+ 1077us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.099943 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.100110 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.100325 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.100556 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":39}
I20260811 12:46:08.101451 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.085396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.0.186.125:46129)
0811 12:46:08.086136 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.086142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.086169 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:46:08.086225 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.086231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.086417 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.086587 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.087435 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.088549 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.089772 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.090334 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.090475 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.094293 (+ 3818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.094305 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.094321 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.094352 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.097605 (+ 3253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.098340 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.098352 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.098358 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.098517 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.098979 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.098988 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.098993 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.099751 (+ 758us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.099984 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.100495 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.100822 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":584,"thread_start_us":437,"threads_started":1}
I20260811 12:46:08.104101 27226 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:46:08.105355 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.104879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58382)
0811 12:46:08.105085 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.105198 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 12:46:08.105651 27170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.107327 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.106979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58390)
0811 12:46:08.107133 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.107213 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 12:46:08.107702 27226 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab.
Entry for principal kudu/127.0.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab.
I20260811 12:46:08.141588 745 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVJER3t/build/asan/bin/kudu
/tmp/dist-test-taskVJER3t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:46069
--webserver_interface=127.0.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab
--principal=kudu/127.0.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.186.84:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.186.126:39823,127.0.186.125:46129,127.0.186.124:46069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 12:46:08.157125 27226 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 1
I20260811 12:46:08.158418 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.157923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58396)
0811 12:46:08.158132 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.158254 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 12:46:08.159560 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.159155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58400)
0811 12:46:08.159353 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.159439 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 12:46:08.159790 27226 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.170107 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } attempt: 5
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:46:08.185057 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.171078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42368 (local address 127.0.186.125:46129)
0811 12:46:08.171302 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.171310 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.171337 (+ 27us) server_negotiation.cc:407] Connection header received
0811 12:46:08.171423 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.171429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.171523 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.171670 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.172459 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.173775 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.174981 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.175829 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.176003 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.179651 (+ 3648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.179656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.179659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.179694 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.182392 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.183207 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.183210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.183213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.183335 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.183735 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.183738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.183740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.184016 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.184141 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.184558 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.184793 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 12:46:08.185210 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.170953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42368)
0811 12:46:08.171159 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.171183 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.171304 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.171703 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.171707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.172100 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.172286 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.172295 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.173920 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.173925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.174816 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.174828 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.175996 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.176000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.176176 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.176908 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.176925 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.179431 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.182532 (+ 3101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.182538 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.182542 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.183086 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.183448 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.183453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.183456 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.183626 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.184136 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.184141 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.184311 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.184471 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.184818 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 12:46:08.186482 27140 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } has no permanent_uuid. Determining permanent_uuid...
I20260811 12:46:08.187737 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.187269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58402)
0811 12:46:08.187463 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.187560 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 12:46:08.188839 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.188448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58408)
0811 12:46:08.188599 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.188694 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 12:46:08.189075 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.228040 27226 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 2
I20260811 12:46:08.229349 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.228840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58420)
0811 12:46:08.229081 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.229179 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 12:46:08.230435 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.230068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58432)
0811 12:46:08.230245 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.230315 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 12:46:08.230659 27226 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.240342 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 1
I20260811 12:46:08.241832 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.241162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58440)
0811 12:46:08.241440 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.241592 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 12:46:08.242934 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.242536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58456)
0811 12:46:08.242694 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.242781 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 12:46:08.243157 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.311452 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 2
I20260811 12:46:08.312908 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.312235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58472)
0811 12:46:08.312529 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.312645 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 12:46:08.314255 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.313849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58480)
0811 12:46:08.314038 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.314143 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 12:46:08.314548 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.321870 27226 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 3
I20260811 12:46:08.322983 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.322510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58482)
0811 12:46:08.322716 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.322824 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 12:46:08.324178 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.323752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58496)
0811 12:46:08.323988 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.324067 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260811 12:46:08.324391 27226 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.420852 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 3
I20260811 12:46:08.422001 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.421511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58510)
0811 12:46:08.421728 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.421829 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 12:46:08.423156 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.422756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58512)
0811 12:46:08.422959 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.423035 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260811 12:46:08.423372 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.467658 27226 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 4
I20260811 12:46:08.469023 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.468407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58520)
0811 12:46:08.468671 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.468820 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 12:46:08.470168 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.469818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58522)
0811 12:46:08.469985 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.470056 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 12:46:08.470369 27226 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
W20260811 12:46:08.520902 27234 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 12:46:08.521315 27234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:46:08.521449 27234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:46:08.521593 27234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:46:08.529543 27234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:46:08.529678 27234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 12:46:08.529744 27234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:46:08.529798 27234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:46:08.529855 27234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:46:08.540309 27234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.186.84:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.186.126:39823,127.0.186.125:46129,127.0.186.124:46069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/krb5kdc/kudu_127.0.186.124.keytab
--principal=kudu/127.0.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.186.124:46069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:46:08.541850 27234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:46:08.543207 27234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:46:08.555850 27239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:08.555794 27242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:46:08.555874 27240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:46:08.557010 27234 server_base.cc:1034] running on GCE node
I20260811 12:46:08.557861 27234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:46:08.559329 27234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:46:08.560598 27234 hybrid_clock.cc:648] HybridClock initialized: now 1786452368560526 us; error 43 us; skew 500 ppm
I20260811 12:46:08.560997 27234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452368, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 12:46:08.564527 27234 init.cc:377] Logged in from keytab as kudu/127.0.186.124@KRBTEST.COM (short username kudu)
I20260811 12:46:08.566135 27234 webserver.cc:460] Webserver started at http://127.0.186.124:36325/ using document root <none> and password file <none>
I20260811 12:46:08.566838 27234 fs_manager.cc:359] Metadata directory not provided
I20260811 12:46:08.566931 27234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:46:08.567576 27234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:46:08.571033 27234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data/instance:
uuid: "93150e2e516a47329d48e38b3cbdf1ea"
format_stamp: "Formatted at 2026-08-11 12:46:08 on dist-test-slave-qg60"
server_key: "8f33d43e33b4dc108e786c85244f5864"
server_key_iv: "375865312247d4d624bc2a92445c9d3c"
server_key_version: "encryptionkey@0"
I20260811 12:46:08.571856 27234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal/instance:
uuid: "93150e2e516a47329d48e38b3cbdf1ea"
format_stamp: "Formatted at 2026-08-11 12:46:08 on dist-test-slave-qg60"
server_key: "8f33d43e33b4dc108e786c85244f5864"
server_key_iv: "375865312247d4d624bc2a92445c9d3c"
server_key_version: "encryptionkey@0"
I20260811 12:46:08.577457 27234 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 12:46:08.581311 27249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 12:46:08.582793 27234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260811 12:46:08.582963 27234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data,/tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal
uuid: "93150e2e516a47329d48e38b3cbdf1ea"
format_stamp: "Formatted at 2026-08-11 12:46:08 on dist-test-slave-qg60"
server_key: "8f33d43e33b4dc108e786c85244f5864"
server_key_iv: "375865312247d4d624bc2a92445c9d3c"
server_key_version: "encryptionkey@0"
I20260811 12:46:08.583185 27234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:46:08.600591 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 4
I20260811 12:46:08.601824 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.601317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58526)
0811 12:46:08.601568 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.601668 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 12:46:08.601895 27234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 12:46:08.603210 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.602602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58536)
0811 12:46:08.602832 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.602942 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 12:46:08.603513 27140 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.186.124:46069: Network error: Client connection negotiation failed: client connection to 127.0.186.124:46069: connect: Connection refused (error 111)
I20260811 12:46:08.606752 27234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:46:08.607041 27234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:46:08.627332 27234 rpc_server.cc:307] RPC server started. Bound to: 127.0.186.124:46069
I20260811 12:46:08.627351 27303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.186.124:46069 every 8 connection(s)
I20260811 12:46:08.628880 27234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/data/info.pb
I20260811 12:46:08.632158 745 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVJER3t/build/asan/bin/kudu as pid 27234
I20260811 12:46:08.632365 745 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVJER3t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786451972721996-745-0/minicluster-data/master-2/wal/instance
I20260811 12:46:08.632987 745 external_mini_cluster.cc:1428] Setting key a519fe14199ef63aa45246af0e65724e
I20260811 12:46:08.633421 27304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:46:08.643508 27304 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452368, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
I20260811 12:46:08.658879 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.634964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.0.186.124:46069)
0811 12:46:08.635825 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.635836 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.635908 (+ 72us) server_negotiation.cc:407] Connection header received
0811 12:46:08.638234 (+ 2326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.638256 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.638671 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.639011 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.640962 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.642303 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.644164 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.645014 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.645183 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.650281 (+ 5098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.650289 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.650299 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.650336 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.653600 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.654539 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.654546 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.654553 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.654750 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.655231 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.655239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.655245 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.656040 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.656319 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.656853 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.657365 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":398,"threads_started":1}
I20260811 12:46:08.663980 27308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.646770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.0.186.126:39823)
0811 12:46:08.647366 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.647373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.647915 (+ 542us) server_negotiation.cc:407] Connection header received
0811 12:46:08.648106 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.648114 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.648250 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.648361 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.649853 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.650709 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.652243 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.652670 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.652874 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.657043 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.657050 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.657055 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.657098 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.660528 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.661504 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.661513 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.661517 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.661742 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.662183 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.662188 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.662191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.662509 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.662686 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.663290 (+ 604us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.663520 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":276,"threads_started":1}
I20260811 12:46:08.663978 27309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.646704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.126:39823 (local address 127.0.0.1:48904)
0811 12:46:08.647747 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.647796 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.647963 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.648464 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.648472 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.649391 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.649668 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.649678 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.650892 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.650896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.652041 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.652054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.652951 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.652959 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.653136 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.653842 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.653869 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.656821 (+ 2952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.660677 (+ 3856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.660688 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.660694 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.661357 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.661896 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.661900 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.661903 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.662047 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.662664 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.662671 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.662925 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.663130 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.663498 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"thread_start_us":613,"threads_started":1}
I20260811 12:46:08.665613 27304 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.126@KRBTEST.COM
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452368, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:46:08.681202 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.662590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48910 (local address 127.0.186.126:39823)
0811 12:46:08.663232 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.663236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.663255 (+ 19us) server_negotiation.cc:407] Connection header received
0811 12:46:08.663302 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.663305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.663357 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.663478 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.665121 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.666266 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.668132 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.668817 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.668960 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.674353 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.674359 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.674362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.674433 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.678003 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.678921 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.678926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.678929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.679104 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.679545 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.679550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.679553 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.679922 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.680210 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.680518 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.680790 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":328,"threads_started":1}
I20260811 12:46:08.681686 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.666504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.0.186.125:46129)
0811 12:46:08.666709 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.666715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.666745 (+ 30us) server_negotiation.cc:407] Connection header received
0811 12:46:08.666969 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.666973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.667034 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.667112 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.668034 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.669125 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.670937 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.671375 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.671472 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.674919 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.674928 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.674934 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.674985 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.678479 (+ 3494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.679337 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.679341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.679344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.679527 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.679954 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.679961 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.679967 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.680342 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.680519 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.681050 (+ 531us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.681313 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 12:46:08.682154 27309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.666483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.125:46129 (local address 127.0.0.1:42384)
0811 12:46:08.666680 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.666700 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.666850 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.667174 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.667178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.667658 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.667889 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.667902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.669277 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.669283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.670766 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.670786 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.671546 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.671553 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.671801 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.672373 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.672416 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.674680 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.678668 (+ 3988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.678675 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.678680 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.679158 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.679673 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.679676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.679679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.679823 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.680505 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.680509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.680758 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.681113 (+ 355us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.681391 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 12:46:08.683597 27304 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452368, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.124@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.186.125@KRBTEST.COM
I20260811 12:46:08.699311 27309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.684517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58552)
0811 12:46:08.684859 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.684874 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.684964 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.685348 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.685351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.685919 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.686105 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.686125 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.687424 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.687428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.688763 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.688781 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.689801 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.689808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.690006 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.690568 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.690585 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.692781 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.696534 (+ 3753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.696537 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.696540 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.697009 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.697410 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.697415 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.697419 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.697591 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.698336 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.698341 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.698509 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.698665 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.698893 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241}
I20260811 12:46:08.699592 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.684503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58552 (local address 127.0.186.124:46069)
0811 12:46:08.684691 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.684697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.684953 (+ 256us) server_negotiation.cc:407] Connection header received
0811 12:46:08.685051 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.685055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.685175 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.685297 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.686279 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.687267 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.688913 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.689619 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.689718 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.692957 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.692962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.692965 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.692995 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.696378 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.697141 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.697147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.697150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.697292 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.697732 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.697735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.697737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.698204 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.698326 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.698810 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.699176 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 12:46:08.700198 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.683400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.0.186.125:46129)
0811 12:46:08.683572 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.683576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.683592 (+ 16us) server_negotiation.cc:407] Connection header received
0811 12:46:08.683631 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.683634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.683686 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.683763 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.685530 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.686549 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.688136 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.688871 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.688991 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.693648 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.693653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.693656 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.693719 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.697032 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.697902 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.697907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.697910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.698101 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.698534 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.698538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.698540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.698883 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.699163 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.699707 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.699893 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 12:46:08.705646 27304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: Bootstrap starting.
I20260811 12:46:08.706377 745 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 12:46:08.709273 27304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:08.710355 27304 log.cc:824] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:08.708910 27115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "57ef242749b2495b9f4b6c467c74463e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48910
I20260811 12:46:08.713543 27304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: No bootstrap required, opened a new log
I20260811 12:46:08.720813 27304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.721174 27304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93150e2e516a47329d48e38b3cbdf1ea, State: Initialized, Role: FOLLOWER
I20260811 12:46:08.721635 27304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.722651 27312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:08.723085 27312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:08.723611 27304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:46:08.733791 27327 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:46:08.733935 27327 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:46:08.731307 27234 master_runner.cc:186] Error getting master registration for 127.0.186.126:39823: OK, instance_id { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" instance_seqno: 1786452367453571 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 12:46:08.739727 27234 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 12:46:08.769588 27226 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 5
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.125@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:46:08.787648 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.770611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58560)
0811 12:46:08.770899 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.770921 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.771079 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.771505 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.771511 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.772099 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.772360 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.772373 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.773964 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.773972 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.775439 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.775458 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.776504 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.776510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.776758 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.777506 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.777532 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.780500 (+ 2968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.784597 (+ 4097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.784603 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.784607 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.785198 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.785624 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.785629 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.785632 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.785796 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.786549 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.786554 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.786731 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.786909 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.787246 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260811 12:46:08.787703 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.770646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58560 (local address 127.0.186.124:46069)
0811 12:46:08.770909 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.770914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.770987 (+ 73us) server_negotiation.cc:407] Connection header received
0811 12:46:08.771232 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.771237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.771324 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.771440 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.772538 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.773784 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.775603 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.776332 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.776455 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.780696 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.780701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.780704 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.780779 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.784438 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.785337 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.785343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.785347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.785498 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.785913 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.785918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.785922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.786412 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.786598 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.787026 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.787272 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 12:46:08.794145 27226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: Bootstrap starting.
I20260811 12:46:08.798460 27226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:08.799870 27226 log.cc:824] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:08.803440 27226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: No bootstrap required, opened a new log
I20260811 12:46:08.814922 27226 raft_consensus.cc:348] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.815378 27226 raft_consensus.cc:729] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96a13ffdf66453e8dd828faf7db26f3, State: Initialized, Role: FOLLOWER
I20260811 12:46:08.815958 27226 consensus_queue.cc:260] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.817094 27330 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:08.817591 27330 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:08.818451 27226 sys_catalog.cc:564] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 12:46:08.839825 27343 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:46:08.840006 27343 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:46:08.826243 27149 master_runner.cc:186] Error getting master registration for 127.0.186.126:39823: OK, instance_id { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" instance_seqno: 1786452367453571 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 12:46:08.841746 27149 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 12:46:08.859570 27256 tablet.cc:2369] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:46:08.880795 27140 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } attempt: 5
Aug 11 12:46:08 dist-test-slave-qg60 krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786452367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.186.126@KRBTEST.COM for kudu/127.0.186.124@KRBTEST.COM
I20260811 12:46:08.897373 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.881600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.186.124:46069 (local address 127.0.0.1:58566)
0811 12:46:08.881907 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 12:46:08.881927 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 12:46:08.882064 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 12:46:08.882541 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 12:46:08.882545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 12:46:08.883004 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0811 12:46:08.883187 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.883198 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.884765 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.884772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.885741 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 12:46:08.885754 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.886876 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.886882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 12:46:08.887116 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.887836 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 12:46:08.887896 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0811 12:46:08.890919 (+ 3023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 12:46:08.894450 (+ 3531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.894458 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.894464 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.894997 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.895431 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 12:46:08.895436 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 12:46:08.895440 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 12:46:08.895656 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 12:46:08.896287 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 12:46:08.896292 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 12:46:08.896456 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 12:46:08.896617 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 12:46:08.896966 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189}
I20260811 12:46:08.897431 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:08.881645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58566 (local address 127.0.186.124:46069)
0811 12:46:08.881859 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:08.881866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:08.882180 (+ 314us) server_negotiation.cc:407] Connection header received
0811 12:46:08.882276 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:08.882282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:08.882385 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:08.882497 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:08.883380 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.884610 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.885927 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:08.886683 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:08.886820 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:08.891178 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:08.891184 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:08.891187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:08.891225 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:08.894271 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.895161 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.895166 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.895170 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.895335 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:08.895789 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:08.895797 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:08.895801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:08.896167 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:08.896315 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:08.896761 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 12:46:08.897007 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 12:46:08.903265 27140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e: Bootstrap starting.
I20260811 12:46:08.907037 27140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e: Neither blocks nor log segments found. Creating new log.
I20260811 12:46:08.908598 27140 log.cc:824] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e: Log is configured to *not* fsync() on all Append() calls
I20260811 12:46:08.912492 27140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e: No bootstrap required, opened a new log
I20260811 12:46:08.920966 27140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.921491 27140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57ef242749b2495b9f4b6c467c74463e, State: Initialized, Role: FOLLOWER
I20260811 12:46:08.922081 27140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.923484 27347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:08.924316 27347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:08.925074 27140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:46:08.925151 27115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 12:46:08.925369 27115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:46:08.932386 27115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.935680 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57ef242749b2495b9f4b6c467c74463e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a96a13ffdf66453e8dd828faf7db26f3"
I20260811 12:46:08.936384 27198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:46:08.941479 27198 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57ef242749b2495b9f4b6c467c74463e in term 1.
I20260811 12:46:08.942601 27090 leader_election.cc:302] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57ef242749b2495b9f4b6c467c74463e, a96a13ffdf66453e8dd828faf7db26f3; no voters:
W20260811 12:46:08.942593 27094 tablet.cc:2369] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:46:08.945897 27277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57ef242749b2495b9f4b6c467c74463e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "93150e2e516a47329d48e38b3cbdf1ea"
I20260811 12:46:08.946574 27277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:46:08.951702 27277 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57ef242749b2495b9f4b6c467c74463e in term 1.
I20260811 12:46:08.953194 27347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:46:08.960817 27115 leader_election.cc:288] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [CANDIDATE]: Term 1 election: Requested vote from peers a96a13ffdf66453e8dd828faf7db26f3 (127.0.186.125:46129), 93150e2e516a47329d48e38b3cbdf1ea (127.0.186.124:46069)
I20260811 12:46:08.986759 27347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [term 1 LEADER]: Becoming Leader. State: Replica: 57ef242749b2495b9f4b6c467c74463e, State: Running, Role: LEADER
I20260811 12:46:08.988139 27347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } }
I20260811 12:46:08.997638 27358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57ef242749b2495b9f4b6c467c74463e. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:08.998405 27358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:09.000159 27364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260811 12:46:09.025228 27175 tablet.cc:2369] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:46:09.044160 27364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:46:09.075956 27370 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 12:46:09.095785 27277 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [term 1 FOLLOWER]: Refusing update from remote peer 57ef242749b2495b9f4b6c467c74463e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:46:09.097322 27347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [LEADER]: Connected to new peer: Peer: permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:46:09.106968 27198 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [term 1 FOLLOWER]: Refusing update from remote peer 57ef242749b2495b9f4b6c467c74463e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 12:46:09.108244 27347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:46:09.126667 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.010787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58576 (local address 127.0.186.124:46069)
0811 12:46:09.011076 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.011086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.019579 (+ 8493us) server_negotiation.cc:407] Connection header received
0811 12:46:09.020012 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.020022 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.020148 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.020249 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.049328 (+ 29079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.050434 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.057674 (+ 7240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.058428 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.058548 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.083055 (+ 24507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:09.083064 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:09.083070 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:09.083129 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:09.112053 (+ 28924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:09.120839 (+ 8786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:09.120846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:09.120850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:09.121109 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:09.122165 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:09.122170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:09.122174 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:09.123716 (+ 1542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:09.125232 (+ 1516us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.125378 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.126186 (+ 808us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 12:46:09.128579 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.005144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42394 (local address 127.0.186.125:46129)
0811 12:46:09.005368 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.005376 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.014501 (+ 9125us) server_negotiation.cc:407] Connection header received
0811 12:46:09.015627 (+ 1126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.015636 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.015764 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.015865 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.045935 (+ 30070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.047185 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.052349 (+ 5164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.053158 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.053263 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.084306 (+ 31043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:09.084316 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:09.084321 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:09.084373 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:09.119097 (+ 34724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:09.120611 (+ 1514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:09.120618 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:09.120621 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:09.125590 (+ 4969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:09.126143 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:09.126148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:09.126152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:09.126606 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:09.127739 (+ 1133us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.127903 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.128200 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 12:46:09.133456 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.003637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48922 (local address 127.0.186.126:39823)
0811 12:46:09.003904 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.003913 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.023847 (+ 19934us) server_negotiation.cc:407] Connection header received
0811 12:46:09.024249 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.024259 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.024404 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.024510 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.029710 (+ 5200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.031324 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.044516 (+ 13192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.045232 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.045341 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.071430 (+ 26089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 12:46:09.071455 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 12:46:09.071464 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 12:46:09.071537 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 12:46:09.076974 (+ 5437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:09.121743 (+ 44769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:09.121795 (+ 52us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:09.121801 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:09.122001 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 12:46:09.130461 (+ 8460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 12:46:09.130469 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 12:46:09.130473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 12:46:09.131063 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 12:46:09.131767 (+ 704us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.132800 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.133090 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 12:46:09.148792 27330 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57ef242749b2495b9f4b6c467c74463e. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:09.149323 27330 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:09.158705 27347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:09.159389 27347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:09.164505 27364 catalog_manager.cc:1347] Generated new cluster ID: 63b0d7dec1344c799782dd3e87ab83ca
I20260811 12:46:09.164661 27364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:46:09.166916 27312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57ef242749b2495b9f4b6c467c74463e. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:09.167236 27312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:09.168208 27330 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:09.168510 27330 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:09.181131 27358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:09.181466 27358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e [sys.catalog]: This master's current role is: LEADER
I20260811 12:46:09.182031 27312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57ef242749b2495b9f4b6c467c74463e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ef242749b2495b9f4b6c467c74463e" member_type: VOTER last_known_addr { host: "127.0.186.126" port: 39823 } } peers { permanent_uuid: "a96a13ffdf66453e8dd828faf7db26f3" member_type: VOTER last_known_addr { host: "127.0.186.125" port: 46129 } } peers { permanent_uuid: "93150e2e516a47329d48e38b3cbdf1ea" member_type: VOTER last_known_addr { host: "127.0.186.124" port: 46069 } } }
I20260811 12:46:09.182309 27312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea [sys.catalog]: This master's current role is: FOLLOWER
I20260811 12:46:09.183406 27373 mvcc.cc:205] Tried to move back new op lower bound from 7317308903798157312 to 7317308903388127232. Current Snapshot: MvccSnapshot[applied={T|T < 7317308903798157312}]
I20260811 12:46:09.202535 27364 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:46:09.204649 27364 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:46:09.229357 27364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57ef242749b2495b9f4b6c467c74463e: Generated new TSK 0
I20260811 12:46:09.230647 27364 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 12:46:09.359865 27307 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.333570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58584 (local address 127.0.186.124:46069)
0811 12:46:09.333896 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.333903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.357092 (+ 23189us) server_negotiation.cc:407] Connection header received
0811 12:46:09.357810 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.357817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.357918 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.358003 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.359562 (+ 1559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58584: BlockingRecv error: recv got EOF from 127.0.0.1:58584 (error 108)
Metrics: {"server-negotiator.queue_time_us":194}
W20260811 12:46:09.363476 27310 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.334276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48932 (local address 127.0.186.126:39823)
0811 12:46:09.334475 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.334481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.360919 (+ 26438us) server_negotiation.cc:407] Connection header received
0811 12:46:09.361661 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.361668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.361785 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.361861 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.363161 (+ 1300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48932: BlockingRecv error: recv got EOF from 127.0.0.1:48932 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 12:46:09.365670 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.334056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42410 (local address 127.0.186.125:46129)
0811 12:46:09.334329 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.334338 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.361528 (+ 27190us) server_negotiation.cc:407] Connection header received
0811 12:46:09.364184 (+ 2656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.364191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.364282 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.364356 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.365406 (+ 1050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42410: BlockingRecv error: recv got EOF from 127.0.0.1:42410 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 12:46:09.374408 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.371777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42422 (local address 127.0.186.125:46129)
0811 12:46:09.371955 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.371962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.372557 (+ 595us) server_negotiation.cc:407] Connection header received
0811 12:46:09.372839 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.372848 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.372999 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.373136 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.374061 (+ 925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42422: BlockingRecv error: recv got EOF from 127.0.0.1:42422 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 12:46:09.385303 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.382867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42434 (local address 127.0.186.125:46129)
0811 12:46:09.383066 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.383072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.383629 (+ 557us) server_negotiation.cc:407] Connection header received
0811 12:46:09.383828 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.383835 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.383948 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.384082 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.385056 (+ 974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42434: BlockingRecv error: recv got EOF from 127.0.0.1:42434 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 12:46:09.396878 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.394427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.0.186.125:46129)
0811 12:46:09.394623 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.394629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.395182 (+ 553us) server_negotiation.cc:407] Connection header received
0811 12:46:09.395383 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.395389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.395515 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.395631 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.396567 (+ 936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42446: BlockingRecv error: recv got EOF from 127.0.0.1:42446 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 12:46:09.407632 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.404808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42456 (local address 127.0.186.125:46129)
0811 12:46:09.405066 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.405073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.405646 (+ 573us) server_negotiation.cc:407] Connection header received
0811 12:46:09.405918 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.405924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.406047 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.406178 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.407292 (+ 1114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42456: BlockingRecv error: recv got EOF from 127.0.0.1:42456 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
W20260811 12:46:09.421763 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.419274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42460 (local address 127.0.186.125:46129)
0811 12:46:09.419465 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.419471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.420036 (+ 565us) server_negotiation.cc:407] Connection header received
0811 12:46:09.420230 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.420236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.420344 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.420466 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.421494 (+ 1028us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42460: BlockingRecv error: recv got EOF from 127.0.0.1:42460 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 12:46:09.444111 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.441563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42462 (local address 127.0.186.125:46129)
0811 12:46:09.441774 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.441781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.442385 (+ 604us) server_negotiation.cc:407] Connection header received
0811 12:46:09.442606 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.442618 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.442761 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.442923 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.443835 (+ 912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42462: BlockingRecv error: recv got EOF from 127.0.0.1:42462 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 12:46:09.485446 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.482893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.0.186.125:46129)
0811 12:46:09.483137 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.483147 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.483786 (+ 639us) server_negotiation.cc:407] Connection header received
0811 12:46:09.484033 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.484038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.484126 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.484246 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.485161 (+ 915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42466: BlockingRecv error: recv got EOF from 127.0.0.1:42466 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 12:46:09.555961 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.553663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42480 (local address 127.0.186.125:46129)
0811 12:46:09.553962 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.553969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.554342 (+ 373us) server_negotiation.cc:407] Connection header received
0811 12:46:09.554588 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.554593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.554667 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.554758 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.555740 (+ 982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42480: BlockingRecv error: recv got EOF from 127.0.0.1:42480 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260811 12:46:09.690335 27231 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 12:46:09.688173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.0.186.125:46129)
0811 12:46:09.688454 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.688464 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.688868 (+ 404us) server_negotiation.cc:407] Connection header received
0811 12:46:09.689122 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.689127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.689202 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.689316 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 12:46:09.690129 (+ 813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42488: BlockingRecv error: recv got EOF from 127.0.0.1:42488 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 12:46:09.736132 27327 catalog_manager.cc:1259] Loaded cluster ID: 63b0d7dec1344c799782dd3e87ab83ca
I20260811 12:46:09.736243 27327 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: loading cluster ID for follower catalog manager: success
I20260811 12:46:09.739079 27327 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: acquiring CA information for follower catalog manager: success
I20260811 12:46:09.741178 27327 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 93150e2e516a47329d48e38b3cbdf1ea: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:46:09.842356 27343 catalog_manager.cc:1259] Loaded cluster ID: 63b0d7dec1344c799782dd3e87ab83ca
I20260811 12:46:09.842475 27343 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: loading cluster ID for follower catalog manager: success
I20260811 12:46:09.845746 27343 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: acquiring CA information for follower catalog manager: success
I20260811 12:46:09.848111 27343 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a96a13ffdf66453e8dd828faf7db26f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 12:46:09.957098 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.950822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42498 (local address 127.0.186.125:46129)
0811 12:46:09.951014 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.951019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.951298 (+ 279us) server_negotiation.cc:407] Connection header received
0811 12:46:09.951430 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.951435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.951634 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.951753 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:09.952226 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.953058 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.954546 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.954983 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.955089 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.955652 (+ 563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:09.956421 (+ 769us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:09.956583 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.956693 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.956840 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 12:46:09.970461 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.964028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.0.186.124:46069)
0811 12:46:09.964584 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.964591 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.964745 (+ 154us) server_negotiation.cc:407] Connection header received
0811 12:46:09.965035 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.965039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.965205 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.965399 (+ 194us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:09.965870 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.966712 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.968084 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.968499 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.968641 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.969231 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:09.969772 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:09.969953 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.970067 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.970157 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":290,"threads_started":1}
I20260811 12:46:09.989980 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.977817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58610 (local address 127.0.186.124:46069)
0811 12:46:09.978636 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.978645 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.982350 (+ 3705us) server_negotiation.cc:407] Connection header received
0811 12:46:09.982451 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.982460 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.982585 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.982694 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:09.983545 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.984656 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.987015 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.987865 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.988035 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.988601 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:09.988795 (+ 194us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:09.988917 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.989507 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.989600 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624}
I20260811 12:46:09.990439 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.977252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42500 (local address 127.0.186.125:46129)
0811 12:46:09.977489 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.977500 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.983099 (+ 5599us) server_negotiation.cc:407] Connection header received
0811 12:46:09.983464 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.983469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.983568 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.983671 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:09.984310 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.985513 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.987970 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.988625 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.988781 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.989561 (+ 780us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:09.989703 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:09.989805 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.990036 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.990146 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 12:46:09.990381 27457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 12:46:09.977189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48934 (local address 127.0.186.126:39823)
0811 12:46:09.983404 (+ 6215us) server_negotiation.cc:206] Beginning negotiation
0811 12:46:09.983410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 12:46:09.983428 (+ 18us) server_negotiation.cc:407] Connection header received
0811 12:46:09.983555 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 12:46:09.983560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 12:46:09.983802 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 12:46:09.984017 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 12:46:09.984758 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.985725 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.987815 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 12:46:09.988451 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 12:46:09.988627 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 12:46:09.989338 (+ 711us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 12:46:09.989693 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 12:46:09.989823 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 12:46:09.989977 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 12:46:09.990061 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6056,"thread_start_us":5954,"threads_started":1}
I20260811 12:46:09.996155 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 27070
I20260811 12:46:09.997264 27135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:46:10.113840 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 27070
I20260811 12:46:10.143121 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 27149
I20260811 12:46:10.144336 27219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:46:10.267990 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 27149
I20260811 12:46:10.294416 745 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVJER3t/build/asan/bin/kudu pid 27234
I20260811 12:46:10.295748 27299 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:46:10.408790 745 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVJER3t/build/asan/bin/kudu with pid 27234
2026-08-11T12:46:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5189 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10295 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (397645 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST